← Logs

social_media_monitor_2026-10-03.log

2026-10-03 20:00:41,845 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-10-03 20:00:41,845 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-10-03 20:00:41,846 - __main__ - INFO - No new results found across all enabled sources
2026-10-03 20:00:41,846 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-03 20:00:41,846 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-10-03 20:00:41,846 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-03 20:00:41,846 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 20:00:41,917 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-03 20:00:41,918 - __main__ - INFO - Closed all database connections
2026-10-03 20:00:41,920 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 20:00:41,920 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-03 20:30:01,676 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-03.log
2026-10-03 20:30:01,676 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-03.log
2026-10-03 20:30:01,676 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-03.log
2026-10-03 20:30:01,676 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-03 20:30:01,716 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-03 20:30:01,716 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-03 20:30:01,719 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-03 20:30:01,720 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-03 20:30:01,735 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-03 20:30:01,735 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-03 20:30:01,738 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-03 20:30:01,739 - __main__ - INFO - GitHub scraper initialized and enabled
2026-10-03 20:30:01,739 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-10-03 20:30:01,739 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-03 20:30:01,742 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-03 20:30:01,742 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-03 20:30:01,745 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-03 20:30:01,750 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-03 20:30:01,750 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-03 20:30:01,753 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-03 20:30:01,753 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-03 20:30:01,753 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-03 20:30:01,755 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-03 20:30:01,755 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-10-03 20:30:01,755 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-03 20:30:01,756 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-10-03 20:30:02,187 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-10-03 20:30:02,188 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-10-03 20:30:03,035 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-03 20:30:03,059 - GitHubScraper - INFO - Found 665 GitHub repositories for term: "Hermes Agent"
2026-10-03 20:30:03,211 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-10-03 20:30:03,607 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-03 20:30:03,608 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-10-03 20:30:04,207 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-10-03 20:30:04,666 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-03 20:30:04,667 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-10-03 20:30:05,280 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:05,281 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-10-03 20:30:06,117 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-03 20:30:06,121 - GitHubScraper - INFO - Found 44 GitHub repositories for term: "prime agent"
2026-10-03 20:30:07,087 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-03 20:30:07,091 - GitHubScraper - INFO - Found 270 GitHub repositories for term: paperclip
2026-10-03 20:30:07,232 - GitHubScraper - INFO - Total GitHub results found: 0
2026-10-03 20:30:08,754 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-10-03 20:30:09,135 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:09,174 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:09,205 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:09,217 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:09,484 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:09,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:09,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:09,692 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:09,844 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:09,904 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:09,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:10,002 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:10,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:10,311 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:10,536 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 20:30:10,613 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:10,825 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:10,828 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 20:30:10,971 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:11,119 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:11,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 20:30:11,311 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:11,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:11,475 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:11,647 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:11,846 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 20:30:11,882 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:11,975 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:11,986 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:12,197 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 20:30:12,332 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:12,419 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:12,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:12,666 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:12,719 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:12,873 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 20:30:12,885 - YouTubeIntelScraper - INFO - YouTube Intel found 35 candidates and 9 new videos
2026-10-03 20:30:12,936 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:13,075 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:13,239 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:13,295 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 20:30:13,340 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:13,583 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:13,610 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:13,717 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:13,880 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:13,910 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:14,032 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:14,047 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:14,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:14,365 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:14,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:14,479 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:14,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:14,722 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:14,802 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:15,069 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:15,126 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:15,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:15,226 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 20:30:15,469 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:15,516 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:15,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:15,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:15,783 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:15,860 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:15,887 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,052 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,167 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,170 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,230 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,349 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,503 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,560 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,789 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,897 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:16,968 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:17,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:17,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:17,262 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:17,371 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:17,475 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:17,581 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:17,722 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:17,739 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:17,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:17,933 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:18,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:18,072 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:18,230 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:18,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:18,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:18,361 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:18,486 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:18,748 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:18,786 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:18,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:19,015 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 20:30:19,077 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-10-03 20:30:19,078 - __main__ - INFO - Scraper github completed: 0 results
2026-10-03 20:30:19,078 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-10-03 20:30:19,078 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-10-03 20:30:20,116 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-03 20:30:20.116540
2026-10-03 20:30:20,116 - __main__ - INFO - Email sent successfully
2026-10-03 20:30:20,116 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-03 20:30:20,117 - __main__ - INFO - Monitor complete. Found 9 total results: 9 new youtube intel results.
2026-10-03 20:30:20,117 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-03 20:30:20,117 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 20:30:20,207 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-03 20:30:20,208 - __main__ - INFO - Closed all database connections
2026-10-03 20:30:20,210 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 20:30:20,210 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-03 21:00:02,112 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-03.log
2026-10-03 21:00:02,112 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-03.log
2026-10-03 21:00:02,112 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-03.log
2026-10-03 21:00:02,112 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-03 21:00:02,142 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-03 21:00:02,142 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-03 21:00:02,144 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-03 21:00:02,145 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-03 21:00:02,159 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-03 21:00:02,160 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-03 21:00:02,164 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-03 21:00:02,166 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-03 21:00:02,166 - __main__ - INFO - RSS scraper initialized and enabled
2026-10-03 21:00:02,171 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-03 21:00:02,172 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-03 21:00:02,172 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-10-03 21:00:02,177 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-03 21:00:02,181 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-03 21:00:02,181 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-03 21:00:02,183 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-03 21:00:02,183 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-03 21:00:02,183 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-03 21:00:02,186 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-03 21:00:02,186 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-10-03 21:00:02,186 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-03 21:00:02,186 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-10-03 21:00:02,274 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-10-03 21:00:02,279 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-10-03 21:00:02,279 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-10-03 21:00:02,280 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-10-03 21:00:02,792 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-10-03 21:00:03,310 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-10-03 21:00:03,544 - Yiddish24Scraper - INFO - Received response with 547139 characters
2026-10-03 21:00:03,545 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318839 chars)
2026-10-03 21:00:03,546 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-10-03 21:00:03,637 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-10-03 21:00:03,681 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-10-03 21:00:03,681 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-10-03 21:00:04,391 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-10-03 21:00:04,391 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-10-03 21:00:04,392 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-10-03 21:00:04,392 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-10-03 21:00:18,031 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-10-03 21:00:43,428 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-10-03 21:00:43,429 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-10-03 21:00:43,429 - __main__ - INFO - Scraper rss completed: 0 results
2026-10-03 21:00:43,429 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-10-03 21:00:43,429 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-10-03 21:00:43,429 - __main__ - INFO - No new results found across all enabled sources
2026-10-03 21:00:43,430 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-03 21:00:43,430 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-10-03 21:00:43,430 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-03 21:00:43,430 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 21:00:43,497 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-03 21:00:43,498 - __main__ - INFO - Closed all database connections
2026-10-03 21:00:43,500 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 21:00:43,500 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-03 22:00:02,342 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-03.log
2026-10-03 22:00:02,342 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-03.log
2026-10-03 22:00:02,343 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-03.log
2026-10-03 22:00:02,343 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-03 22:00:02,372 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-03 22:00:02,372 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-03 22:00:02,375 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-03 22:00:02,375 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-03 22:00:02,407 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-03 22:00:02,407 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-03 22:00:02,463 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-03 22:00:02,464 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-03 22:00:02,465 - __main__ - INFO - RSS scraper initialized and enabled
2026-10-03 22:00:02,471 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-03 22:00:02,471 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-03 22:00:02,471 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-10-03 22:00:02,477 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-03 22:00:02,482 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-03 22:00:02,482 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-03 22:00:02,484 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-03 22:00:02,484 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-03 22:00:02,484 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-03 22:00:02,486 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-03 22:00:02,486 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-10-03 22:00:02,487 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-03 22:00:02,487 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-10-03 22:00:02,581 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-10-03 22:00:02,585 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-10-03 22:00:02,585 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-10-03 22:00:02,586 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-10-03 22:00:03,009 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-10-03 22:00:03,427 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-10-03 22:00:03,686 - Yiddish24Scraper - INFO - Received response with 547139 characters
2026-10-03 22:00:03,691 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318839 chars)
2026-10-03 22:00:03,694 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-10-03 22:00:03,768 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-10-03 22:00:03,818 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-10-03 22:00:03,818 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-10-03 22:00:04,580 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-10-03 22:00:04,580 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-10-03 22:00:04,580 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-10-03 22:00:04,580 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-10-03 22:00:15,175 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-10-03 22:00:37,066 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-10-03 22:00:37,066 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-10-03 22:00:37,066 - __main__ - INFO - Scraper rss completed: 0 results
2026-10-03 22:00:37,066 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-10-03 22:00:37,066 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-10-03 22:00:37,067 - __main__ - INFO - No new results found across all enabled sources
2026-10-03 22:00:37,067 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-03 22:00:37,067 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-10-03 22:00:37,067 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-03 22:00:37,067 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 22:00:37,108 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-03 22:00:37,108 - __main__ - INFO - Closed all database connections
2026-10-03 22:00:37,110 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 22:00:37,110 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-03 22:30:01,952 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-03.log
2026-10-03 22:30:01,952 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-03.log
2026-10-03 22:30:01,953 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-03.log
2026-10-03 22:30:01,953 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-03 22:30:01,981 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-03 22:30:01,981 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-03 22:30:01,984 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-03 22:30:01,984 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-03 22:30:02,000 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-03 22:30:02,000 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-03 22:30:02,005 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-03 22:30:02,007 - __main__ - INFO - GitHub scraper initialized and enabled
2026-10-03 22:30:02,007 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-10-03 22:30:02,008 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-03 22:30:02,014 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-03 22:30:02,014 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-03 22:30:02,019 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-03 22:30:02,025 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-03 22:30:02,025 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-03 22:30:02,027 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-03 22:30:02,028 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-03 22:30:02,028 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-03 22:30:02,030 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-03 22:30:02,030 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-10-03 22:30:02,030 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-03 22:30:02,031 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-10-03 22:30:02,456 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-10-03 22:30:02,456 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-10-03 22:30:03,166 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-03 22:30:03,192 - GitHubScraper - INFO - Found 665 GitHub repositories for term: "Hermes Agent"
2026-10-03 22:30:03,465 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-10-03 22:30:03,728 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-03 22:30:03,729 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-10-03 22:30:04,473 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-10-03 22:30:04,710 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-03 22:30:04,711 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-10-03 22:30:05,522 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-10-03 22:30:06,190 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-03 22:30:06,194 - GitHubScraper - INFO - Found 44 GitHub repositories for term: "prime agent"
2026-10-03 22:30:07,298 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-03 22:30:07,303 - GitHubScraper - INFO - Found 270 GitHub repositories for term: paperclip
2026-10-03 22:30:07,445 - GitHubScraper - INFO - Total GitHub results found: 0
2026-10-03 22:30:08,538 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-10-03 22:30:08,945 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 22:30:08,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:08,971 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:08,979 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:09,309 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:09,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:09,330 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:09,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:09,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:09,640 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:09,677 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:09,769 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:09,901 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:10,000 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:10,037 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:10,268 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:10,323 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:10,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 22:30:10,537 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:10,675 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 22:30:10,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:10,723 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:10,903 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:11,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:11,172 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:11,200 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:11,359 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 22:30:11,523 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:11,557 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 22:30:11,566 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:11,819 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:11,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:11,918 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:12,036 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:12,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:12,364 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:12,419 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:12,440 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:12,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:12,769 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:12,796 - YouTubeIntelScraper - INFO - YouTube Intel found 35 candidates and 4 new videos
2026-10-03 22:30:12,861 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:12,939 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:12,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:13,154 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 22:30:13,224 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:13,359 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:13,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:13,516 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:13,544 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:13,823 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:13,831 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-03 22:30:13,950 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:13,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:14,110 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:14,256 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:14,486 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:14,489 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:14,518 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:14,692 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:14,864 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:14,876 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,031 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,199 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,232 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,387 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,396 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,582 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,610 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,736 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,757 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,908 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:15,910 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,095 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,201 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,385 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,589 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,743 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,792 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:16,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,028 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,112 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,120 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,160 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,442 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,491 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,496 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,635 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,762 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,818 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:17,844 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:18,098 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:18,193 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:18,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-03 22:30:18,400 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=1 list_repos=100 list_new=0 private_new=0 total_new=1
2026-10-03 22:30:18,402 - __main__ - INFO - Scraper github completed: 0 results
2026-10-03 22:30:18,402 - __main__ - INFO - Scraper github_feed completed: 1 results
2026-10-03 22:30:18,402 - __main__ - INFO - Scraper youtube_intel completed: 4 results
2026-10-03 22:30:19,457 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-03 22:30:19.457616
2026-10-03 22:30:19,457 - __main__ - INFO - Email sent successfully
2026-10-03 22:30:19,468 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed
2026-10-03 22:30:19,468 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-03 22:30:19,468 - __main__ - INFO - Monitor complete. Found 5 total results: 1 new github feed results, 4 new youtube intel results.
2026-10-03 22:30:19,468 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-03 22:30:19,468 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 22:30:19,781 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-03 22:30:19,781 - __main__ - INFO - Closed all database connections
2026-10-03 22:30:19,784 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 22:30:19,784 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-03 23:00:02,517 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-03.log
2026-10-03 23:00:02,517 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-03.log
2026-10-03 23:00:02,517 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-03.log
2026-10-03 23:00:02,517 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-03 23:00:02,553 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-03 23:00:02,554 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-03 23:00:02,556 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-03 23:00:02,557 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-03 23:00:02,578 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-03 23:00:02,579 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-03 23:00:02,636 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-03 23:00:02,638 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-03 23:00:02,638 - __main__ - INFO - RSS scraper initialized and enabled
2026-10-03 23:00:02,643 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-03 23:00:02,643 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-03 23:00:02,643 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-10-03 23:00:02,647 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-03 23:00:02,654 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-03 23:00:02,654 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-03 23:00:02,657 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-03 23:00:02,657 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-03 23:00:02,657 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-03 23:00:02,661 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-03 23:00:02,661 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-10-03 23:00:02,661 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-03 23:00:02,662 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-10-03 23:00:02,763 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-10-03 23:00:02,768 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-10-03 23:00:02,768 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-10-03 23:00:02,769 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-10-03 23:00:03,045 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-10-03 23:00:03,526 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-10-03 23:00:03,769 - Yiddish24Scraper - INFO - Received response with 547139 characters
2026-10-03 23:00:03,772 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318839 chars)
2026-10-03 23:00:03,774 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-10-03 23:00:03,857 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-10-03 23:00:03,901 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-10-03 23:00:03,901 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-10-03 23:00:04,699 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-10-03 23:00:04,699 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-10-03 23:00:04,699 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-10-03 23:00:04,700 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-10-03 23:00:15,382 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-10-03 23:00:36,388 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-10-03 23:00:36,389 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-10-03 23:00:36,389 - __main__ - INFO - Scraper rss completed: 0 results
2026-10-03 23:00:36,389 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-10-03 23:00:36,389 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-10-03 23:00:36,390 - __main__ - INFO - No new results found across all enabled sources
2026-10-03 23:00:36,390 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-03 23:00:36,390 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-10-03 23:00:36,390 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-03 23:00:36,390 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 23:00:36,471 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-03 23:00:36,471 - __main__ - INFO - Closed all database connections
2026-10-03 23:00:36,473 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-03 23:00:36,474 - social_media_monitor.database.connection - INFO - Closed 0 database connections