← Logs

social_media_monitor_2026-09-04.log

2026-09-04 20:04:08,094 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 20:04:08,095 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-04 20:30:01,825 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-04.log
2026-09-04 20:30:01,825 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-04.log
2026-09-04 20:30:01,825 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-04.log
2026-09-04 20:30:01,825 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-04 20:30:01,856 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-04 20:30:01,857 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-04 20:30:01,859 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-04 20:30:01,859 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-04 20:30:01,873 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-04 20:30:01,873 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-04 20:30:01,876 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-04 20:30:01,877 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-04 20:30:01,877 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-04 20:30:01,878 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-04 20:30:01,883 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-04 20:30:01,883 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-04 20:30:01,887 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-04 20:30:01,892 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-04 20:30:01,892 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-04 20:30:01,894 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-04 20:30:01,894 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-04 20:30:01,894 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-04 20:30:01,897 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-04 20:30:01,897 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-04 20:30:01,898 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-04 20:30:01,898 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-04 20:30:02,302 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-04 20:30:02,303 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-04 20:30:03,101 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-04 20:30:03,189 - GitHubScraper - INFO - Found 580 GitHub repositories for term: "Hermes Agent"
2026-09-04 20:30:03,238 - GitHubScraper - INFO - Added new GitHub repository: awesome-ai-plugins
2026-09-04 20:30:03,348 - GitHubScraper - INFO - Added new GitHub repository: NeMo-Relay
2026-09-04 20:30:03,437 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-04 20:30:04,315 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-04 20:30:04,321 - GitHubScraper - INFO - Found 8432 GitHub repositories for term: "claude code"
2026-09-04 20:30:04,332 - GitHubScraper - INFO - Added new GitHub repository: livewire-powergrid
2026-09-04 20:30:04,347 - GitHubScraper - INFO - Added new GitHub repository: skills
2026-09-04 20:30:04,360 - GitHubScraper - INFO - Added new GitHub repository: router
2026-09-04 20:30:04,376 - GitHubScraper - INFO - Added new GitHub repository: openwork
2026-09-04 20:30:04,390 - GitHubScraper - INFO - Added new GitHub repository: diri
2026-09-04 20:30:04,398 - GitHubScraper - INFO - Added new GitHub repository: roam-code
2026-09-04 20:30:04,444 - GitHubScraper - INFO - Added new GitHub repository: mngr
2026-09-04 20:30:04,684 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-04 20:30:05,351 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-04 20:30:05,353 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-04 20:30:05,745 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:05,746 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-04 20:30:06,499 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-04 20:30:06,503 - GitHubScraper - INFO - Found 257 GitHub repositories for term: paperclip
2026-09-04 20:30:06,643 - GitHubScraper - INFO - Total GitHub results found: 9
2026-09-04 20:30:08,861 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-04 20:30:09,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:09,270 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:09,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:09,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:09,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:09,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:09,649 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:09,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:09,953 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:09,999 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:10,105 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:10,225 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:10,298 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:10,359 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:10,522 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:10,742 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:10,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:10,927 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:11,089 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:11,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 20:30:11,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:11,402 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 20:30:11,507 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:11,524 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:11,550 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:11,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:12,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:12,016 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:12,126 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 20:30:12,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:12,410 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:12,612 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:12,712 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:12,801 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:12,808 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:12,956 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:13,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:13,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:13,369 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 20:30:13,387 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:13,830 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:13,847 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:13,916 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:14,011 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:14,171 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 20:30:14,331 - YouTubeIntelScraper - INFO - YouTube Intel found 55 candidates and 14 new videos
2026-09-04 20:30:14,349 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:14,392 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:14,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:14,558 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:14,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:14,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:14,920 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:14,950 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:15,196 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:15,261 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:15,265 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:15,495 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:15,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 20:30:15,726 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:15,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:15,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:15,945 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:16,168 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:16,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:16,273 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:16,349 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:16,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:16,548 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:16,656 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 20:30:16,748 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:16,818 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:16,936 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,190 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,192 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,206 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,471 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,518 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,552 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,719 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,762 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:17,947 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,176 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,241 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,260 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,300 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,555 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,610 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,612 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,661 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,927 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,987 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:18,991 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:19,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:19,279 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:19,297 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:19,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:19,395 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:19,815 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 20:30:19,861 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-04 20:30:19,862 - __main__ - INFO - Scraper github completed: 9 results
2026-09-04 20:30:19,862 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-04 20:30:19,862 - __main__ - INFO - Scraper youtube_intel completed: 14 results
2026-09-04 20:30:20,570 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-04 20:30:20.570080
2026-09-04 20:30:20,570 - __main__ - INFO - Email sent successfully
2026-09-04 20:30:20,570 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-04 20:30:20,570 - __main__ - INFO - Monitor complete. Found 23 total results: 9 new github results, 14 new youtube intel results.
2026-09-04 20:30:20,570 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-04 20:30:20,570 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 20:30:20,603 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-04 20:30:20,604 - __main__ - INFO - Closed all database connections
2026-09-04 20:30:20,606 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 20:30:20,606 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-04 21:00:02,163 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-04.log
2026-09-04 21:00:02,163 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-04.log
2026-09-04 21:00:02,164 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-04.log
2026-09-04 21:00:02,164 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-04 21:00:02,194 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-04 21:00:02,194 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-04 21:00:02,197 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-04 21:00:02,198 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-04 21:00:02,213 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-04 21:00:02,214 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-04 21:00:02,217 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-04 21:00:02,218 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-04 21:00:02,218 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-04 21:00:02,221 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-04 21:00:02,222 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-04 21:00:02,222 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-04 21:00:02,226 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-04 21:00:02,232 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-04 21:00:02,232 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-04 21:00:02,236 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-04 21:00:02,236 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-04 21:00:02,236 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-04 21:00:02,239 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-04 21:00:02,239 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-04 21:00:02,240 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-04 21:00:02,240 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-04 21:00:02,351 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-04 21:00:02,355 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-04 21:00:02,355 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-04 21:00:02,357 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-04 21:00:02,773 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-04 21:00:05,534 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-04 21:00:05,952 - Yiddish24Scraper - INFO - Received response with 469141 characters
2026-09-04 21:00:05,954 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (300149 chars)
2026-09-04 21:00:05,956 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-04 21:00:06,074 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-04 21:00:06,127 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-04 21:00:06,127 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-04 21:00:06,873 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles
2026-09-04 21:00:06,873 - Yiddish24Scraper - INFO - Page 1: 3/100 new items
2026-09-04 21:00:06,874 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination
2026-09-04 21:00:06,874 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3
2026-09-04 21:00:14,603 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-04 21:00:36,653 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-04 21:00:36,653 - IveltScraper - INFO - All forums scrape complete. Found 14 new posts.
2026-09-04 21:00:36,654 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-04 21:00:36,654 - __main__ - INFO - Scraper yiddish24 completed: 3 results
2026-09-04 21:00:36,654 - __main__ - INFO - Scraper ivelt completed: 14 results
2026-09-04 21:00:37,794 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-04 21:00:37.794748
2026-09-04 21:00:37,795 - __main__ - INFO - Email sent successfully
2026-09-04 21:00:37,795 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-04 21:00:37,795 - __main__ - INFO - Monitor complete. Found 17 total results: 3 new yiddish24 results, 14 new ivelt results.
2026-09-04 21:00:37,795 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-04 21:00:37,795 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 21:00:37,860 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-04 21:00:37,860 - __main__ - INFO - Closed all database connections
2026-09-04 21:00:37,863 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 21:00:37,863 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-04 22:00:01,633 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-04.log
2026-09-04 22:00:01,633 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-04.log
2026-09-04 22:00:01,634 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-04.log
2026-09-04 22:00:01,634 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-04 22:00:01,662 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-04 22:00:01,662 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-04 22:00:01,664 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-04 22:00:01,665 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-04 22:00:01,681 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-04 22:00:01,681 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-04 22:00:01,740 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-04 22:00:01,742 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-04 22:00:01,742 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-04 22:00:01,750 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-04 22:00:01,750 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-04 22:00:01,750 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-04 22:00:01,756 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-04 22:00:01,762 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-04 22:00:01,762 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-04 22:00:01,764 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-04 22:00:01,764 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-04 22:00:01,765 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-04 22:00:01,767 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-04 22:00:01,767 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-04 22:00:01,767 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-04 22:00:01,767 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-04 22:00:01,880 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-04 22:00:01,891 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-04 22:00:01,891 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-04 22:00:01,895 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-04 22:00:02,118 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-04 22:00:04,634 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-04 22:00:04,858 - Yiddish24Scraper - INFO - Received response with 474815 characters
2026-09-04 22:00:04,861 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (304422 chars)
2026-09-04 22:00:04,864 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-04 22:00:04,941 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-04 22:00:04,980 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-04 22:00:04,980 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-04 22:00:05,654 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 100 total articles
2026-09-04 22:00:05,654 - Yiddish24Scraper - INFO - Page 1: 4/100 new items
2026-09-04 22:00:05,655 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination
2026-09-04 22:00:05,655 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4
2026-09-04 22:00:14,266 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-04 22:00:28,883 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-04 22:00:28,883 - IveltScraper - INFO - All forums scrape complete. Found 4 new posts.
2026-09-04 22:00:28,883 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-04 22:00:28,883 - __main__ - INFO - Scraper yiddish24 completed: 4 results
2026-09-04 22:00:28,884 - __main__ - INFO - Scraper ivelt completed: 4 results
2026-09-04 22:00:29,612 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-04 22:00:29.612831
2026-09-04 22:00:29,613 - __main__ - INFO - Email sent successfully
2026-09-04 22:00:29,613 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-04 22:00:29,613 - __main__ - INFO - Monitor complete. Found 8 total results: 4 new yiddish24 results, 4 new ivelt results.
2026-09-04 22:00:29,613 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-04 22:00:29,613 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 22:00:29,654 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-04 22:00:29,654 - __main__ - INFO - Closed all database connections
2026-09-04 22:00:29,655 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 22:00:29,655 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-04 22:30:02,450 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-04.log
2026-09-04 22:30:02,450 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-04.log
2026-09-04 22:30:02,450 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-04.log
2026-09-04 22:30:02,450 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-04 22:30:02,479 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-04 22:30:02,479 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-04 22:30:02,481 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-04 22:30:02,482 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-04 22:30:02,497 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-04 22:30:02,497 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-04 22:30:02,503 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-04 22:30:02,504 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-04 22:30:02,505 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-04 22:30:02,505 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-04 22:30:02,512 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-04 22:30:02,512 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-04 22:30:02,517 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-04 22:30:02,525 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-04 22:30:02,525 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-04 22:30:02,527 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-04 22:30:02,527 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-04 22:30:02,528 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-04 22:30:02,530 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-04 22:30:02,530 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-04 22:30:02,530 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-04 22:30:02,530 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-04 22:30:02,921 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-04 22:30:02,922 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-04 22:30:03,574 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-04 22:30:03,599 - GitHubScraper - INFO - Found 580 GitHub repositories for term: "Hermes Agent"
2026-09-04 22:30:03,769 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-04 22:30:04,737 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-04 22:30:04,778 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-04 22:30:04,782 - GitHubScraper - INFO - Found 8434 GitHub repositories for term: "claude code"
2026-09-04 22:30:04,884 - GitHubScraper - INFO - Added new GitHub repository: KiCadRoutingTools
2026-09-04 22:30:04,892 - GitHubScraper - INFO - Added new GitHub repository: ultimate_bug_scanner
2026-09-04 22:30:05,825 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-04 22:30:05,828 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-04 22:30:05,970 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-04 22:30:06,965 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-04 22:30:06,969 - GitHubScraper - INFO - Found 257 GitHub repositories for term: paperclip
2026-09-04 22:30:07,114 - GitHubScraper - INFO - Total GitHub results found: 2
2026-09-04 22:30:09,015 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-04 22:30:09,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:09,393 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:09,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:09,519 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:09,793 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:09,824 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:09,873 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:09,890 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:10,097 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:10,225 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:10,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:10,405 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:10,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:10,581 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:10,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:10,872 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:10,889 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:11,001 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:11,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:11,187 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:11,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:11,385 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:11,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:11,569 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:11,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:11,666 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:12,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:12,036 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:12,203 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:12,317 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:12,389 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:12,679 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:12,687 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:12,746 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:12,849 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:12,953 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:13,217 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:13,266 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:13,311 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:13,341 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:13,661 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:13,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:13,795 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:13,846 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:14,075 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:14,124 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:14,179 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:14,219 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:14,356 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:14,477 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:14,533 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:14,665 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:14,731 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:14,925 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:14,994 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:15,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:15,226 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:15,420 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:15,478 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:15,613 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:15,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:15,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:15,845 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:15,927 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:16,145 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:16,189 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:16,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:16,345 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:16,551 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:16,557 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:16,685 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:16,715 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:16,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:16,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:17,061 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:17,091 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:17,115 - YouTubeIntelScraper - INFO - YouTube Intel found 54 candidates and 9 new videos
2026-09-04 22:30:17,201 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:17,409 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-04 22:30:17,528 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:17,547 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:17,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:17,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:17,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:17,961 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:17,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,323 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,326 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,584 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,640 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,734 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,940 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:18,987 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:19,057 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:19,158 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:19,283 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:19,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-04 22:30:19,474 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=242 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-04 22:30:19,476 - __main__ - INFO - Scraper github completed: 2 results
2026-09-04 22:30:19,476 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-04 22:30:19,476 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-09-04 22:30:20,358 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-04 22:30:20.358330
2026-09-04 22:30:20,358 - __main__ - INFO - Email sent successfully
2026-09-04 22:30:20,358 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-04 22:30:20,359 - __main__ - INFO - Monitor complete. Found 11 total results: 2 new github results, 9 new youtube intel results.
2026-09-04 22:30:20,359 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-04 22:30:20,359 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 22:30:20,404 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-04 22:30:20,405 - __main__ - INFO - Closed all database connections
2026-09-04 22:30:20,407 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 22:30:20,407 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-04 23:00:01,723 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-04.log
2026-09-04 23:00:01,723 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-04.log
2026-09-04 23:00:01,723 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-04.log
2026-09-04 23:00:01,723 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-04 23:00:01,753 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-04 23:00:01,753 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-04 23:00:01,756 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-04 23:00:01,756 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-04 23:00:01,776 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-04 23:00:01,776 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-04 23:00:01,827 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-04 23:00:01,830 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-04 23:00:01,830 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-04 23:00:01,837 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-04 23:00:01,837 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-04 23:00:01,837 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-04 23:00:01,842 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-04 23:00:01,849 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-04 23:00:01,849 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-04 23:00:01,851 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-04 23:00:01,851 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-04 23:00:01,851 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-04 23:00:01,854 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-04 23:00:01,854 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-04 23:00:01,854 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-04 23:00:01,854 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-04 23:00:01,959 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-04 23:00:01,964 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-04 23:00:01,964 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-04 23:00:01,967 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-04 23:00:02,262 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-04 23:00:02,660 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-04 23:00:02,868 - Yiddish24Scraper - INFO - Received response with 474815 characters
2026-09-04 23:00:02,870 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (304422 chars)
2026-09-04 23:00:02,871 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-04 23:00:02,944 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-04 23:00:02,991 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-04 23:00:02,991 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-04 23:00:03,790 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-04 23:00:03,790 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-04 23:00:03,790 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-04 23:00:03,791 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-04 23:00:14,023 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-04 23:00:33,887 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-04 23:00:33,888 - IveltScraper - INFO - All forums scrape complete. Found 7 new posts.
2026-09-04 23:00:33,888 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-04 23:00:33,888 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-04 23:00:33,888 - __main__ - INFO - Scraper ivelt completed: 7 results
2026-09-04 23:00:34,584 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-04 23:00:34.584705
2026-09-04 23:00:34,585 - __main__ - INFO - Email sent successfully
2026-09-04 23:00:34,585 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-04 23:00:34,585 - __main__ - INFO - Monitor complete. Found 7 total results: 7 new ivelt results.
2026-09-04 23:00:34,585 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-04 23:00:34,585 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 23:00:34,700 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-04 23:00:34,701 - __main__ - INFO - Closed all database connections
2026-09-04 23:00:34,703 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-04 23:00:34,703 - social_media_monitor.database.connection - INFO - Closed 0 database connections