โ† Logs

social_media_monitor_2026-09-19.log

2026-09-19 20:00:31,235 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-19 20:00:31,235 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-19 20:00:31,235 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 20:00:31,268 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-19 20:00:31,268 - __main__ - INFO - Closed all database connections
2026-09-19 20:00:31,270 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 20:00:31,270 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-19 20:30:02,327 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-19.log
2026-09-19 20:30:02,327 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-19.log
2026-09-19 20:30:02,327 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-19.log
2026-09-19 20:30:02,328 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-19 20:30:02,357 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-19 20:30:02,358 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-19 20:30:02,360 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-19 20:30:02,360 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-19 20:30:02,676 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-19 20:30:02,676 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-19 20:30:02,680 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-19 20:30:02,681 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-19 20:30:02,681 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-19 20:30:02,681 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-19 20:30:02,685 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-19 20:30:02,685 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-19 20:30:02,690 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-19 20:30:02,695 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-19 20:30:02,695 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-19 20:30:02,698 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-19 20:30:02,698 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-19 20:30:02,698 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-19 20:30:02,702 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-19 20:30:02,702 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-19 20:30:02,702 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-19 20:30:02,702 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-19 20:30:03,125 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-19 20:30:03,126 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-19 20:30:03,724 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-19 20:30:03,750 - GitHubScraper - INFO - Found 617 GitHub repositories for term: "Hermes Agent"
2026-09-19 20:30:03,952 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-19 20:30:04,348 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-19 20:30:04,349 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-19 20:30:04,966 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-19 20:30:05,316 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-19 20:30:05,317 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-19 20:30:06,242 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-19 20:30:06,688 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-19 20:30:06,774 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-19 20:30:07,710 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-19 20:30:07,714 - GitHubScraper - INFO - Found 260 GitHub repositories for term: paperclip
2026-09-19 20:30:07,866 - GitHubScraper - INFO - Total GitHub results found: 0
2026-09-19 20:30:09,028 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-19 20:30:09,432 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:09,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:09,484 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:09,610 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:09,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:09,871 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:09,888 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:09,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:10,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:10,241 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:10,421 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:10,424 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:10,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:10,693 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:10,727 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:10,830 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:10,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 20:30:11,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:11,176 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 20:30:11,205 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:11,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:11,445 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:11,486 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:11,564 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:11,629 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:11,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:12,035 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:12,047 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:12,291 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:12,430 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:12,450 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:12,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:12,688 - YouTubeIntelScraper - INFO - YouTube Intel found 22 candidates and 3 new videos
2026-09-19 20:30:12,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:12,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:12,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:12,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:13,172 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 20:30:13,335 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:13,367 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:13,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 20:30:13,681 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 20:30:13,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 20:30:13,815 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:13,843 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 20:30:14,105 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 20:30:14,175 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:14,194 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:14,341 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:14,382 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:14,517 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:14,655 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:14,676 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:14,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:14,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,011 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,207 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,467 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,573 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,585 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,593 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,903 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,926 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:15,937 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:16,116 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:16,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:16,297 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:16,501 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:16,509 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:16,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:16,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:16,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:16,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:16,994 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:17,065 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:17,155 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:17,314 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:17,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:17,477 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:17,510 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 20:30:17,639 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:17,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:17,848 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:17,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,013 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,202 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,292 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,303 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,356 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,552 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,565 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,711 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,832 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,888 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:18,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:19,062 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:19,265 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 20:30:19,354 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1
2026-09-19 20:30:19,355 - __main__ - INFO - Scraper github completed: 0 results
2026-09-19 20:30:19,355 - __main__ - INFO - Scraper github_feed completed: 1 results
2026-09-19 20:30:19,355 - __main__ - INFO - Scraper youtube_intel completed: 3 results
2026-09-19 20:30:20,105 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-19 20:30:20.105670
2026-09-19 20:30:20,105 - __main__ - INFO - Email sent successfully
2026-09-19 20:30:20,115 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed
2026-09-19 20:30:20,115 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-19 20:30:20,115 - __main__ - INFO - Monitor complete. Found 4 total results: 1 new github feed results, 3 new youtube intel results.
2026-09-19 20:30:20,115 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-19 20:30:20,115 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 20:30:20,136 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-19 20:30:20,137 - __main__ - INFO - Closed all database connections
2026-09-19 20:30:20,139 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 20:30:20,139 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-19 21:00:02,282 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-19.log
2026-09-19 21:00:02,283 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-19.log
2026-09-19 21:00:02,283 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-19.log
2026-09-19 21:00:02,283 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-19 21:00:02,312 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-19 21:00:02,312 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-19 21:00:02,314 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-19 21:00:02,314 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-19 21:00:02,335 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-19 21:00:02,336 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-19 21:00:02,341 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-19 21:00:02,343 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-19 21:00:02,343 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-19 21:00:02,349 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-19 21:00:02,349 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-19 21:00:02,350 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-19 21:00:02,355 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-19 21:00:02,365 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-19 21:00:02,365 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-19 21:00:02,367 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-19 21:00:02,367 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-19 21:00:02,367 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-19 21:00:02,369 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-19 21:00:02,369 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-19 21:00:02,370 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-19 21:00:02,370 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-19 21:00:02,463 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-19 21:00:02,467 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-19 21:00:02,467 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-19 21:00:02,468 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-19 21:00:02,756 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-19 21:00:03,222 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-19 21:00:03,458 - Yiddish24Scraper - INFO - Received response with 507519 characters
2026-09-19 21:00:03,461 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (314957 chars)
2026-09-19 21:00:03,464 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-19 21:00:03,541 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-19 21:00:03,582 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-19 21:00:03,582 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-19 21:00:04,323 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-19 21:00:04,323 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-19 21:00:04,323 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-19 21:00:04,324 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-19 21:00:14,513 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-19 21:00:29,920 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-19 21:00:30,518 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-19 21:00:30,518 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-19 21:00:30,519 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-19 21:00:30,519 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-19 21:00:30,519 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-19 21:00:30,519 - __main__ - INFO - No new results found across all enabled sources
2026-09-19 21:00:30,520 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-19 21:00:30,520 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-19 21:00:30,520 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-19 21:00:30,520 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 21:00:30,554 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-19 21:00:30,554 - __main__ - INFO - Closed all database connections
2026-09-19 21:00:30,556 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 21:00:30,556 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-19 22:00:02,334 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-19.log
2026-09-19 22:00:02,335 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-19.log
2026-09-19 22:00:02,335 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-19.log
2026-09-19 22:00:02,335 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-19 22:00:02,363 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-19 22:00:02,364 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-19 22:00:02,366 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-19 22:00:02,366 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-19 22:00:02,380 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-19 22:00:02,380 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-19 22:00:02,432 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-19 22:00:02,435 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-19 22:00:02,435 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-19 22:00:02,442 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-19 22:00:02,442 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-19 22:00:02,442 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-19 22:00:02,447 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-19 22:00:02,453 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-19 22:00:02,453 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-19 22:00:02,456 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-19 22:00:02,456 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-19 22:00:02,456 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-19 22:00:02,458 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-19 22:00:02,458 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-19 22:00:02,459 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-19 22:00:02,459 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-19 22:00:02,553 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-19 22:00:02,557 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-19 22:00:02,558 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-19 22:00:02,559 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-19 22:00:02,813 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-19 22:00:03,267 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-19 22:00:03,507 - Yiddish24Scraper - INFO - Received response with 507519 characters
2026-09-19 22:00:03,511 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (314957 chars)
2026-09-19 22:00:03,515 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-19 22:00:03,593 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-19 22:00:03,634 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-19 22:00:03,634 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-19 22:00:04,358 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-19 22:00:04,358 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-19 22:00:04,358 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-19 22:00:04,358 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-19 22:02:08,818 - IveltScraper - INFO - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-09-19 22:02:08,818 - IveltScraper - INFO - Retrying in 3s...
2026-09-19 22:04:18,187 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-09-19 22:04:18,187 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-09-19 22:04:18,187 - IveltScraper - WARNING - No cf_clearance cookie set โ€” skipping curl_cffi fallback
2026-09-19 22:04:18,188 - IveltScraper - ERROR - Failed to fetch ivelt active topics page
2026-09-19 22:04:18,188 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-19 22:04:18,188 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-19 22:04:18,188 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-19 22:04:18,188 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-19 22:04:18,189 - __main__ - INFO - No new results found across all enabled sources
2026-09-19 22:04:18,189 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-19 22:04:18,189 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-19 22:04:18,189 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-19 22:04:18,189 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 22:04:18,230 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-19 22:04:18,231 - __main__ - INFO - Closed all database connections
2026-09-19 22:04:18,233 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 22:04:18,233 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-19 22:30:02,378 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-19.log
2026-09-19 22:30:02,379 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-19.log
2026-09-19 22:30:02,379 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-19.log
2026-09-19 22:30:02,379 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-19 22:30:02,408 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-19 22:30:02,408 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-19 22:30:02,411 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-19 22:30:02,411 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-19 22:30:02,426 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-19 22:30:02,426 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-19 22:30:02,431 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-19 22:30:02,432 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-19 22:30:02,432 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-19 22:30:02,433 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-19 22:30:02,438 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-19 22:30:02,438 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-19 22:30:02,443 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-19 22:30:02,448 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-19 22:30:02,448 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-19 22:30:02,450 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-19 22:30:02,451 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-19 22:30:02,451 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-19 22:30:02,453 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-19 22:30:02,453 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-19 22:30:02,453 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-19 22:30:02,453 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-19 22:30:02,859 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-19 22:30:02,860 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-19 22:30:03,583 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-19 22:30:03,678 - GitHubScraper - INFO - Found 618 GitHub repositories for term: "Hermes Agent"
2026-09-19 22:30:03,841 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-19 22:30:04,192 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-19 22:30:04,193 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-19 22:30:04,797 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-19 22:30:05,184 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-19 22:30:05,184 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-19 22:30:05,943 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-19 22:30:06,650 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-19 22:30:06,745 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-19 22:30:07,776 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-19 22:30:07,779 - GitHubScraper - INFO - Found 260 GitHub repositories for term: paperclip
2026-09-19 22:30:08,205 - GitHubScraper - INFO - Total GitHub results found: 0
2026-09-19 22:30:08,560 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-19 22:30:08,907 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:08,946 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 22:30:09,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:09,040 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:09,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:09,375 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:09,463 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:09,523 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:09,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:09,675 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:09,838 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:09,957 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:09,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:10,041 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:10,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:10,346 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:10,405 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:10,573 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 22:30:10,692 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:10,695 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:10,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:10,969 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:11,045 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:11,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:11,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:11,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:11,695 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:11,742 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:11,753 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:11,862 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:12,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:12,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:12,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:12,331 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:12,429 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:12,446 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:12,679 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:12,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 22:30:12,796 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:12,799 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:13,035 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:13,135 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:13,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 22:30:13,309 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:13,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:13,627 - YouTubeIntelScraper - INFO - YouTube Intel found 21 candidates and 0 new videos
2026-09-19 22:30:13,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:13,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:13,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:13,783 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:13,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:14,036 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:14,051 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:14,149 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:14,334 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:14,399 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:14,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:14,615 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:14,767 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:14,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:14,931 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,076 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,153 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,227 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 22:30:15,305 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,431 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,667 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,789 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,810 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,910 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:15,956 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:16,126 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:16,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:16,265 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:16,294 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:16,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:16,657 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:16,697 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:16,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-19 22:30:16,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:16,985 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,048 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,182 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,203 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,376 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,573 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,736 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,846 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,855 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:17,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:18,057 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:18,119 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:18,204 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:18,335 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:18,368 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:18,544 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-19 22:30:18,635 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-19 22:30:18,636 - __main__ - INFO - Scraper github completed: 0 results
2026-09-19 22:30:18,636 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-19 22:30:18,636 - __main__ - INFO - Scraper youtube_intel completed: 0 results
2026-09-19 22:30:18,637 - __main__ - INFO - No new results found across all enabled sources
2026-09-19 22:30:18,637 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-19 22:30:18,637 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-19 22:30:18,637 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-19 22:30:18,637 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 22:30:18,678 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-19 22:30:18,678 - __main__ - INFO - Closed all database connections
2026-09-19 22:30:18,680 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 22:30:18,680 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-19 23:00:01,866 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-19.log
2026-09-19 23:00:01,867 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-19.log
2026-09-19 23:00:01,867 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-19.log
2026-09-19 23:00:01,867 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-19 23:00:01,897 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-19 23:00:01,897 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-19 23:00:01,900 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-19 23:00:01,900 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-19 23:00:01,914 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-19 23:00:01,914 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-19 23:00:01,917 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-19 23:00:01,918 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-19 23:00:01,918 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-19 23:00:01,922 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-19 23:00:01,922 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-19 23:00:01,922 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-19 23:00:01,925 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-19 23:00:01,929 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-19 23:00:01,929 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-19 23:00:01,932 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-19 23:00:01,932 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-19 23:00:01,932 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-19 23:00:01,934 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-19 23:00:01,934 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-19 23:00:01,934 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-19 23:00:01,934 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-19 23:00:02,026 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-19 23:00:02,031 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-19 23:00:02,031 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-19 23:00:02,033 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-19 23:00:02,292 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-19 23:00:04,450 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-19 23:00:05,386 - Yiddish24Scraper - INFO - Received response with 507519 characters
2026-09-19 23:00:05,389 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (314957 chars)
2026-09-19 23:00:05,393 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-19 23:00:05,485 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-19 23:00:05,530 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-19 23:00:05,530 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-19 23:00:06,418 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-19 23:00:06,419 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-19 23:00:06,419 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-19 23:00:06,419 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-19 23:00:13,958 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-19 23:00:28,751 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-19 23:00:29,439 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-19 23:00:29,439 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-19 23:00:29,440 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-19 23:00:29,440 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-19 23:00:29,440 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-19 23:00:29,441 - __main__ - INFO - No new results found across all enabled sources
2026-09-19 23:00:29,441 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-19 23:00:29,441 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-19 23:00:29,441 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-19 23:00:29,441 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 23:00:29,558 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-19 23:00:29,558 - __main__ - INFO - Closed all database connections
2026-09-19 23:00:29,561 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-19 23:00:29,561 - social_media_monitor.database.connection - INFO - Closed 0 database connections