← Logs
social_media_monitor_2026-09-20.log
2026-09-20 20:00:47,461 - __main__ - INFO - Email sent successfully
2026-09-20 20:00:47,461 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-20 20:00:47,461 - __main__ - INFO - Monitor complete. Found 13 total results: 1 new yiddish24 results, 12 new ivelt results.
2026-09-20 20:00:47,461 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-20 20:00:47,461 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 20:00:47,624 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-20 20:00:47,624 - __main__ - INFO - Closed all database connections
2026-09-20 20:00:47,627 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 20:00:47,627 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-20 20:30:01,949 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-20.log
2026-09-20 20:30:01,950 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-20.log
2026-09-20 20:30:01,950 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-20.log
2026-09-20 20:30:01,950 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-20 20:30:01,980 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-20 20:30:01,981 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-20 20:30:01,983 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-20 20:30:01,984 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-20 20:30:02,016 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-20 20:30:02,016 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-20 20:30:02,023 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-20 20:30:02,024 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-20 20:30:02,025 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-20 20:30:02,025 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-20 20:30:02,032 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-20 20:30:02,032 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-20 20:30:02,038 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-20 20:30:02,044 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-20 20:30:02,044 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-20 20:30:02,046 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-20 20:30:02,046 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-20 20:30:02,047 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-20 20:30:02,050 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-20 20:30:02,050 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-20 20:30:02,050 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-20 20:30:02,050 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-20 20:30:02,487 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-20 20:30:02,487 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-20 20:30:03,263 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-20 20:30:03,357 - GitHubScraper - INFO - Found 625 GitHub repositories for term: "Hermes Agent"
2026-09-20 20:30:03,451 - GitHubScraper - INFO - Added new GitHub repository: wslmanager
2026-09-20 20:30:03,541 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-20 20:30:03,902 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-20 20:30:03,903 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-20 20:30:04,561 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-20 20:30:04,894 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-20 20:30:04,895 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-20 20:30:05,548 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-20 20:30:06,391 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-20 20:30:06,395 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"
2026-09-20 20:30:07,472 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-20 20:30:07,475 - GitHubScraper - INFO - Found 261 GitHub repositories for term: paperclip
2026-09-20 20:30:07,623 - GitHubScraper - INFO - Total GitHub results found: 1
2026-09-20 20:30:08,569 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-20 20:30:08,924 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:08,936 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:08,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:09,092 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:09,222 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:09,286 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:09,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:09,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:09,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:09,667 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:09,849 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:09,884 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:09,949 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:10,020 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:10,148 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:10,239 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:10,365 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 20:30:10,396 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:10,558 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:10,684 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 20:30:10,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:10,861 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:10,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:11,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:11,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:11,293 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:11,411 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:11,450 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:11,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:11,671 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:11,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:11,974 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:12,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:12,104 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:12,111 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:12,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:12,485 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 20:30:12,536 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 20:30:12,615 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 20:30:12,802 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:12,953 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 20:30:12,956 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:13,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 20:30:13,132 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:13,338 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 20:30:13,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:13,550 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:13,570 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:13,689 - YouTubeIntelScraper - INFO - YouTube Intel found 22 candidates and 4 new videos
2026-09-20 20:30:13,698 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:13,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:13,886 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:14,010 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:14,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:14,192 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:14,245 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:14,369 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:14,575 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:14,760 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:14,773 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:14,790 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,154 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,483 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,516 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,525 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,565 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,894 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,898 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:15,939 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:16,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:16,246 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:16,292 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:16,334 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:16,505 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:16,712 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:16,742 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:16,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:16,810 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,069 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,099 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 20:30:17,167 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,377 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,413 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,487 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,496 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,673 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,684 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,823 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:17,945 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:18,136 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:18,143 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:18,171 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:18,289 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:18,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:18,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 20:30:18,610 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-20 20:30:18,611 - __main__ - INFO - Scraper github completed: 1 results
2026-09-20 20:30:18,611 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-20 20:30:18,611 - __main__ - INFO - Scraper youtube_intel completed: 4 results
2026-09-20 20:30:19,267 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-20 20:30:19.267847
2026-09-20 20:30:19,268 - __main__ - INFO - Email sent successfully
2026-09-20 20:30:19,268 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-20 20:30:19,268 - __main__ - INFO - Monitor complete. Found 5 total results: 1 new github results, 4 new youtube intel results.
2026-09-20 20:30:19,268 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-20 20:30:19,268 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 20:30:19,322 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-20 20:30:19,322 - __main__ - INFO - Closed all database connections
2026-09-20 20:30:19,324 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 20:30:19,325 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-20 21:00:02,493 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-20.log
2026-09-20 21:00:02,493 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-20.log
2026-09-20 21:00:02,493 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-20.log
2026-09-20 21:00:02,493 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-20 21:00:02,524 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-20 21:00:02,524 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-20 21:00:02,526 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-20 21:00:02,527 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-20 21:00:02,612 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-20 21:00:02,612 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-20 21:00:02,618 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-20 21:00:02,620 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-20 21:00:02,620 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-20 21:00:02,626 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-20 21:00:02,626 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-20 21:00:02,626 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-20 21:00:02,632 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-20 21:00:02,641 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-20 21:00:02,641 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-20 21:00:02,643 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-20 21:00:02,643 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-20 21:00:02,643 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-20 21:00:02,646 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-20 21:00:02,646 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-20 21:00:02,646 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-20 21:00:02,646 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-20 21:00:02,734 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-20 21:00:02,738 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-20 21:00:02,738 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-20 21:00:02,740 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-20 21:00:03,433 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-20 21:00:04,530 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-20 21:00:04,744 - Yiddish24Scraper - INFO - Received response with 476843 characters
2026-09-20 21:00:04,747 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (298911 chars)
2026-09-20 21:00:04,750 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-20 21:00:04,825 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-20 21:00:04,866 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-20 21:00:04,866 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-20 21:00:05,822 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-20 21:00:05,822 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-20 21:00:05,822 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-20 21:00:05,823 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-20 21:00:15,128 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-20 21:00:45,574 - IveltScraper - INFO - ivelt scrape complete. Checked 8 topics.
2026-09-20 21:00:45,574 - IveltScraper - INFO - All forums scrape complete. Found 7 new posts.
2026-09-20 21:00:45,575 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-20 21:00:45,575 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-20 21:00:45,575 - __main__ - INFO - Scraper ivelt completed: 7 results
2026-09-20 21:00:46,238 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-20 21:00:46.238594
2026-09-20 21:00:46,238 - __main__ - INFO - Email sent successfully
2026-09-20 21:00:46,239 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-20 21:00:46,239 - __main__ - INFO - Monitor complete. Found 7 total results: 7 new ivelt results.
2026-09-20 21:00:46,239 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-20 21:00:46,239 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 21:00:46,382 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-20 21:00:46,382 - __main__ - INFO - Closed all database connections
2026-09-20 21:00:46,384 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 21:00:46,384 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-20 22:00:01,649 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-20.log
2026-09-20 22:00:01,649 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-20.log
2026-09-20 22:00:01,649 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-20.log
2026-09-20 22:00:01,649 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-20 22:00:01,685 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-20 22:00:01,685 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-20 22:00:01,688 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-20 22:00:01,688 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-20 22:00:01,701 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-20 22:00:01,701 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-20 22:00:01,869 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-20 22:00:01,870 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-20 22:00:01,870 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-20 22:00:01,876 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-20 22:00:01,876 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-20 22:00:01,876 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-20 22:00:01,881 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-20 22:00:01,889 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-20 22:00:01,889 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-20 22:00:01,891 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-20 22:00:01,891 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-20 22:00:01,892 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-20 22:00:01,894 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-20 22:00:01,894 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-20 22:00:01,894 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-20 22:00:01,894 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-20 22:00:01,990 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-20 22:00:01,995 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-20 22:00:01,995 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-20 22:00:01,996 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-20 22:00:02,303 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-20 22:00:02,770 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-20 22:00:02,995 - Yiddish24Scraper - INFO - Received response with 476843 characters
2026-09-20 22:00:02,999 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (298911 chars)
2026-09-20 22:00:03,002 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-20 22:00:03,077 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-20 22:00:03,117 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-20 22:00:03,117 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-20 22:00:03,813 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-20 22:00:03,813 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-20 22:00:03,813 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-20 22:00:03,814 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-20 22:00:14,220 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-20 22:00:41,272 - IveltScraper - INFO - ivelt scrape complete. Checked 8 topics.
2026-09-20 22:00:41,272 - IveltScraper - INFO - All forums scrape complete. Found 2 new posts.
2026-09-20 22:00:41,273 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-20 22:00:41,273 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-20 22:00:41,273 - __main__ - INFO - Scraper ivelt completed: 2 results
2026-09-20 22:00:41,936 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-20 22:00:41.936530
2026-09-20 22:00:41,936 - __main__ - INFO - Email sent successfully
2026-09-20 22:00:41,937 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-20 22:00:41,937 - __main__ - INFO - Monitor complete. Found 2 total results: 2 new ivelt results.
2026-09-20 22:00:41,937 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-20 22:00:41,937 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 22:00:42,022 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-20 22:00:42,023 - __main__ - INFO - Closed all database connections
2026-09-20 22:00:42,025 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 22:00:42,025 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-20 22:30:02,298 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-20.log
2026-09-20 22:30:02,299 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-20.log
2026-09-20 22:30:02,299 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-20.log
2026-09-20 22:30:02,299 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-20 22:30:02,327 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-20 22:30:02,327 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-20 22:30:02,330 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-20 22:30:02,330 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-20 22:30:02,344 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-20 22:30:02,344 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-20 22:30:02,347 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-20 22:30:02,347 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-20 22:30:02,347 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-20 22:30:02,348 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-20 22:30:02,350 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-20 22:30:02,351 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-20 22:30:02,354 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-20 22:30:02,359 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-20 22:30:02,359 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-20 22:30:02,362 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-20 22:30:02,362 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-20 22:30:02,362 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-20 22:30:02,365 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-20 22:30:02,366 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-20 22:30:02,366 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-20 22:30:02,366 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-20 22:30:02,761 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-20 22:30:02,762 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-20 22:30:03,402 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-20 22:30:03,429 - GitHubScraper - INFO - Found 625 GitHub repositories for term: "Hermes Agent"
2026-09-20 22:30:03,666 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-20 22:30:03,993 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-20 22:30:03,994 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-20 22:30:04,506 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-20 22:30:04,992 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-20 22:30:04,993 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-20 22:30:05,694 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-20 22:30:06,518 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-20 22:30:06,616 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"
2026-09-20 22:30:07,646 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-20 22:30:07,649 - GitHubScraper - INFO - Found 261 GitHub repositories for term: paperclip
2026-09-20 22:30:07,810 - GitHubScraper - INFO - Total GitHub results found: 0
2026-09-20 22:30:08,538 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-20 22:30:08,847 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:08,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:08,988 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:09,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:09,203 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:09,369 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:09,400 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:09,524 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:09,542 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:09,700 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:09,733 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:09,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:10,056 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:10,068 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:10,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:10,305 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:10,434 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 22:30:10,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:10,630 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:10,633 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:10,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:10,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:10,986 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:11,064 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:11,132 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:11,369 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:11,440 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:11,475 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:11,585 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:11,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:11,744 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:12,064 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:12,072 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:12,110 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:12,275 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:12,402 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:12,525 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 22:30:12,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:12,700 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:12,785 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 22:30:12,990 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:13,112 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:13,164 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 22:30:13,248 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 22:30:13,289 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:13,400 - YouTubeIntelScraper - INFO - YouTube Intel found 22 candidates and 4 new videos
2026-09-20 22:30:13,498 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:13,520 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:13,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:13,630 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:13,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:13,975 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:13,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:14,005 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:14,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:14,257 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:14,333 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:14,371 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:14,709 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:14,725 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:14,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:14,828 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,089 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,114 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,195 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,415 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,479 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,492 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,705 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,756 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,784 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:15,851 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,016 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,096 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,152 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,215 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,359 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,511 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,513 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,563 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,768 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-20 22:30:16,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:16,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,051 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,222 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,280 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,301 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,368 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,503 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,560 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,642 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,658 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,833 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,902 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,913 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:17,988 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:18,172 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:18,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-20 22:30:18,362 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=1 list_repos=100 list_new=0 private_new=0 total_new=1
2026-09-20 22:30:18,363 - __main__ - INFO - Scraper github completed: 0 results
2026-09-20 22:30:18,363 - __main__ - INFO - Scraper github_feed completed: 1 results
2026-09-20 22:30:18,363 - __main__ - INFO - Scraper youtube_intel completed: 4 results
2026-09-20 22:30:18,914 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-20 22:30:18.914109
2026-09-20 22:30:18,914 - __main__ - INFO - Email sent successfully
2026-09-20 22:30:18,924 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed
2026-09-20 22:30:18,924 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-20 22:30:18,925 - __main__ - INFO - Monitor complete. Found 5 total results: 1 new github feed results, 4 new youtube intel results.
2026-09-20 22:30:18,925 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-20 22:30:18,925 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 22:30:18,950 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-20 22:30:18,950 - __main__ - INFO - Closed all database connections
2026-09-20 22:30:18,953 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 22:30:18,953 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-20 23:00:02,014 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-20.log
2026-09-20 23:00:02,014 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-20.log
2026-09-20 23:00:02,014 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-20.log
2026-09-20 23:00:02,014 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-20 23:00:02,064 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-20 23:00:02,064 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-20 23:00:02,066 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-20 23:00:02,067 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-20 23:00:02,082 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-20 23:00:02,082 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-20 23:00:02,137 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-20 23:00:02,140 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-20 23:00:02,140 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-20 23:00:02,147 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-20 23:00:02,147 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-20 23:00:02,147 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-20 23:00:02,152 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-20 23:00:02,159 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-20 23:00:02,159 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-20 23:00:02,162 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-20 23:00:02,162 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-20 23:00:02,162 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-20 23:00:02,165 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-20 23:00:02,165 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-20 23:00:02,165 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-20 23:00:02,166 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-20 23:00:02,274 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-20 23:00:02,279 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-20 23:00:02,279 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-20 23:00:02,282 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-20 23:00:02,638 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-20 23:00:04,046 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-20 23:00:04,277 - Yiddish24Scraper - INFO - Received response with 476843 characters
2026-09-20 23:00:04,280 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (298911 chars)
2026-09-20 23:00:04,283 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-20 23:00:04,367 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-20 23:00:04,410 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-20 23:00:04,410 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-20 23:00:05,102 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-20 23:00:05,103 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-20 23:00:05,103 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-20 23:00:05,103 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-20 23:00:14,372 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-20 23:00:41,018 - IveltScraper - INFO - ivelt scrape complete. Checked 8 topics.
2026-09-20 23:00:41,019 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-20 23:00:41,019 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-20 23:00:41,019 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-20 23:00:41,019 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-20 23:00:41,019 - __main__ - INFO - No new results found across all enabled sources
2026-09-20 23:00:41,020 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-20 23:00:41,020 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-20 23:00:41,020 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-20 23:00:41,020 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 23:00:41,409 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-20 23:00:41,409 - __main__ - INFO - Closed all database connections
2026-09-20 23:00:41,411 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-20 23:00:41,411 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active — waiting for new lines...