← Logs

social_media_monitor_2026-10-04.log

2026-10-04 20:00:29,928 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 20:00:29,953 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-04 20:00:29,953 - __main__ - INFO - Closed all database connections
2026-10-04 20:00:29,956 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 20:00:29,956 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-04 20:30:01,780 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-04.log
2026-10-04 20:30:01,780 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-04.log
2026-10-04 20:30:01,780 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-04.log
2026-10-04 20:30:01,780 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-04 20:30:01,810 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-04 20:30:01,810 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-04 20:30:01,812 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-04 20:30:01,813 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-04 20:30:01,830 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-04 20:30:01,831 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-04 20:30:01,888 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-04 20:30:01,890 - __main__ - INFO - GitHub scraper initialized and enabled
2026-10-04 20:30:01,890 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-10-04 20:30:01,891 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-04 20:30:01,899 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-04 20:30:01,900 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-04 20:30:01,905 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-04 20:30:01,912 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-04 20:30:01,912 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-04 20:30:01,915 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-04 20:30:01,915 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-04 20:30:01,915 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-04 20:30:01,917 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-04 20:30:01,918 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-10-04 20:30:01,918 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-04 20:30:01,918 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-10-04 20:30:02,357 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-10-04 20:30:02,358 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-10-04 20:30:03,009 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-04 20:30:03,036 - GitHubScraper - INFO - Found 667 GitHub repositories for term: "Hermes Agent"
2026-10-04 20:30:03,187 - GitHubScraper - INFO - Added new GitHub repository: awesome-rsi
2026-10-04 20:30:03,455 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-10-04 20:30:03,599 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-04 20:30:03,600 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-10-04 20:30:04,390 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-10-04 20:30:04,599 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-04 20:30:04,600 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-10-04 20:30:05,579 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-10-04 20:30:06,069 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-04 20:30:06,072 - GitHubScraper - INFO - Found 44 GitHub repositories for term: "prime agent"
2026-10-04 20:30:07,102 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-04 20:30:07,106 - GitHubScraper - INFO - Found 270 GitHub repositories for term: paperclip
2026-10-04 20:30:07,249 - GitHubScraper - INFO - Total GitHub results found: 1
2026-10-04 20:30:08,478 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-10-04 20:30:08,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:08,906 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:08,930 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:09,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:09,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:09,288 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:09,334 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:09,420 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:09,565 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:09,698 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:09,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:09,769 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:09,854 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:10,103 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:10,128 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:10,253 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:10,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:10,481 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:10,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:10,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:10,687 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 20:30:10,816 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:10,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:11,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:11,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 20:30:11,316 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:11,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:11,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:11,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:11,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 20:30:11,940 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:11,953 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:12,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 20:30:12,101 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:12,303 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:12,398 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:12,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:12,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 20:30:12,655 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:12,881 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:12,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 20:30:12,961 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:13,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:13,196 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:13,341 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 20:30:13,373 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:13,410 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:13,510 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:13,689 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:13,780 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:13,869 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:14,037 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:14,083 - YouTubeIntelScraper - INFO - YouTube Intel found 34 candidates and 10 new videos
2026-10-04 20:30:14,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 20:30:14,146 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:14,222 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:14,536 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:14,624 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:14,632 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:14,653 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,025 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,042 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,049 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,310 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,396 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,608 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,757 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:15,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,065 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,212 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,365 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,425 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,557 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,772 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,821 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,838 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:16,949 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,076 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,173 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,176 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,295 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,417 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,485 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,503 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,771 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:17,881 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:18,038 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:18,095 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:18,303 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:18,332 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:18,434 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:18,649 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 20:30:18,702 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-10-04 20:30:18,703 - __main__ - INFO - Scraper github completed: 1 results
2026-10-04 20:30:18,703 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-10-04 20:30:18,704 - __main__ - INFO - Scraper youtube_intel completed: 10 results
2026-10-04 20:30:19,734 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-04 20:30:19.734871
2026-10-04 20:30:19,735 - __main__ - INFO - Email sent successfully
2026-10-04 20:30:19,735 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-04 20:30:19,735 - __main__ - INFO - Monitor complete. Found 11 total results: 1 new github results, 10 new youtube intel results.
2026-10-04 20:30:19,735 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-04 20:30:19,735 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 20:30:19,771 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-04 20:30:19,771 - __main__ - INFO - Closed all database connections
2026-10-04 20:30:19,774 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 20:30:19,774 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-04 21:00:02,620 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-04.log
2026-10-04 21:00:02,620 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-04.log
2026-10-04 21:00:02,621 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-04.log
2026-10-04 21:00:02,621 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-04 21:00:02,649 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-04 21:00:02,649 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-04 21:00:02,652 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-04 21:00:02,652 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-04 21:00:02,666 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-04 21:00:02,666 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-04 21:00:02,670 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-04 21:00:02,672 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-04 21:00:02,672 - __main__ - INFO - RSS scraper initialized and enabled
2026-10-04 21:00:02,678 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-04 21:00:02,678 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-04 21:00:02,678 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-10-04 21:00:02,683 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-04 21:00:02,687 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-04 21:00:02,687 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-04 21:00:02,690 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-04 21:00:02,690 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-04 21:00:02,690 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-04 21:00:02,692 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-04 21:00:02,692 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-10-04 21:00:02,692 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-04 21:00:02,692 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-10-04 21:00:02,781 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-10-04 21:00:02,785 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-10-04 21:00:02,785 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-10-04 21:00:02,787 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-10-04 21:00:03,248 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-10-04 21:00:03,715 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-10-04 21:00:03,941 - Yiddish24Scraper - INFO - Received response with 547139 characters
2026-10-04 21:00:03,942 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318839 chars)
2026-10-04 21:00:03,944 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-10-04 21:00:04,014 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-10-04 21:00:04,059 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-10-04 21:00:04,059 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-10-04 21:00:04,958 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-10-04 21:00:04,958 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-10-04 21:00:04,958 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-10-04 21:00:04,959 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-10-04 21:00:18,020 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-10-04 21:00:36,624 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-10-04 21:00:36,625 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-10-04 21:00:36,625 - __main__ - INFO - Scraper rss completed: 0 results
2026-10-04 21:00:36,625 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-10-04 21:00:36,625 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-10-04 21:00:36,625 - __main__ - INFO - No new results found across all enabled sources
2026-10-04 21:00:36,625 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-04 21:00:36,625 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-10-04 21:00:36,626 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-04 21:00:36,626 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 21:00:36,663 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-04 21:00:36,663 - __main__ - INFO - Closed all database connections
2026-10-04 21:00:36,665 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 21:00:36,665 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-04 22:00:02,521 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-04.log
2026-10-04 22:00:02,521 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-04.log
2026-10-04 22:00:02,522 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-04.log
2026-10-04 22:00:02,522 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-04 22:00:02,550 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-04 22:00:02,550 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-04 22:00:02,552 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-04 22:00:02,553 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-04 22:00:02,570 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-04 22:00:02,570 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-04 22:00:02,629 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-04 22:00:02,632 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-04 22:00:02,632 - __main__ - INFO - RSS scraper initialized and enabled
2026-10-04 22:00:02,640 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-04 22:00:02,640 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-04 22:00:02,640 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-10-04 22:00:02,646 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-04 22:00:02,651 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-04 22:00:02,651 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-04 22:00:02,654 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-04 22:00:02,654 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-04 22:00:02,655 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-04 22:00:02,657 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-04 22:00:02,657 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-10-04 22:00:02,657 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-04 22:00:02,658 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-10-04 22:00:02,775 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-10-04 22:00:02,779 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-10-04 22:00:02,780 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-10-04 22:00:02,783 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-10-04 22:00:03,177 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-10-04 22:00:03,667 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-10-04 22:00:03,898 - Yiddish24Scraper - INFO - Received response with 547139 characters
2026-10-04 22:00:03,902 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318839 chars)
2026-10-04 22:00:03,905 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-10-04 22:00:03,987 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-10-04 22:00:04,045 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-10-04 22:00:04,045 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-10-04 22:00:04,957 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-10-04 22:00:04,957 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-10-04 22:00:04,957 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-10-04 22:00:04,957 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-10-04 22:02:03,418 - IveltScraper - INFO - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-10-04 22:02:03,418 - IveltScraper - INFO - Retrying in 3s...
2026-10-04 22:04:12,657 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-10-04 22:04:12,658 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-10-04 22:04:12,658 - IveltScraper - WARNING - No cf_clearance cookie set — skipping curl_cffi fallback
2026-10-04 22:04:12,658 - IveltScraper - ERROR - Failed to fetch ivelt active topics page
2026-10-04 22:04:12,658 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-10-04 22:04:12,659 - __main__ - INFO - Scraper rss completed: 0 results
2026-10-04 22:04:12,659 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-10-04 22:04:12,659 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-10-04 22:04:12,659 - __main__ - INFO - No new results found across all enabled sources
2026-10-04 22:04:12,659 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-04 22:04:12,660 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-10-04 22:04:12,660 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-04 22:04:12,660 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 22:04:12,952 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-04 22:04:12,952 - __main__ - INFO - Closed all database connections
2026-10-04 22:04:12,954 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 22:04:12,954 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-04 22:30:01,834 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-04.log
2026-10-04 22:30:01,834 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-04.log
2026-10-04 22:30:01,834 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-04.log
2026-10-04 22:30:01,834 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-04 22:30:01,864 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-04 22:30:01,864 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-04 22:30:01,866 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-04 22:30:01,867 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-04 22:30:01,879 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-04 22:30:01,879 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-04 22:30:01,883 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-04 22:30:01,884 - __main__ - INFO - GitHub scraper initialized and enabled
2026-10-04 22:30:01,884 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-10-04 22:30:01,885 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-04 22:30:01,890 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-04 22:30:01,890 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-04 22:30:01,895 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-04 22:30:01,900 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-04 22:30:01,900 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-04 22:30:01,902 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-04 22:30:01,902 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-04 22:30:01,902 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-04 22:30:01,904 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-04 22:30:01,904 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-10-04 22:30:01,905 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-04 22:30:01,905 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-10-04 22:30:02,306 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-10-04 22:30:02,307 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-10-04 22:30:03,013 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-04 22:30:03,041 - GitHubScraper - INFO - Found 668 GitHub repositories for term: "Hermes Agent"
2026-10-04 22:30:03,191 - GitHubScraper - INFO - Added new GitHub repository: hermes-gadget-sdk
2026-10-04 22:30:03,519 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-10-04 22:30:03,565 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-04 22:30:03,565 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-10-04 22:30:04,580 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-10-04 22:30:04,829 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-04 22:30:04,830 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-10-04 22:30:05,683 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-10-04 22:30:06,026 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-04 22:30:06,124 - GitHubScraper - INFO - Found 44 GitHub repositories for term: "prime agent"
2026-10-04 22:30:07,158 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-04 22:30:07,162 - GitHubScraper - INFO - Found 271 GitHub repositories for term: paperclip
2026-10-04 22:30:07,199 - GitHubScraper - INFO - Added new GitHub repository: suna
2026-10-04 22:30:07,357 - GitHubScraper - INFO - Total GitHub results found: 2
2026-10-04 22:30:07,776 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-10-04 22:30:08,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:08,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:08,219 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 22:30:08,250 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:08,530 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:08,560 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:08,570 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:08,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:08,899 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:08,918 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:08,954 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:09,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:09,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:09,253 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:09,324 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:09,556 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:09,590 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 22:30:09,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:09,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 22:30:09,912 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:09,991 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:10,074 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 22:30:10,106 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:10,209 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:10,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:10,656 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 22:30:10,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:10,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 22:30:10,858 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:11,119 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:11,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:11,245 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:11,309 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:11,464 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:11,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:11,729 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:11,737 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 22:30:11,821 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:11,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:12,168 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:12,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:12,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:12,299 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:12,568 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 22:30:12,584 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:12,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:12,869 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:12,885 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:12,891 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:13,202 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:13,297 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:13,311 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:13,416 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:13,499 - YouTubeIntelScraper - INFO - YouTube Intel found 34 candidates and 8 new videos
2026-10-04 22:30:13,600 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:13,617 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:13,868 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:13,913 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:14,033 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:14,151 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:14,285 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:14,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:14,448 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:14,451 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:14,635 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:14,673 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:14,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:14,895 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,016 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,059 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,063 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,298 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,345 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,363 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 22:30:15,412 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,604 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,639 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,715 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,933 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:15,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:16,023 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:16,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-04 22:30:16,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:16,318 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:16,397 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:16,444 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:16,634 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:16,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:16,693 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:16,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:16,999 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:17,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:17,044 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:17,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:17,281 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:17,346 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:17,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:17,510 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:17,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:17,872 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-04 22:30:17,938 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-10-04 22:30:17,939 - __main__ - INFO - Scraper github completed: 2 results
2026-10-04 22:30:17,939 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-10-04 22:30:17,939 - __main__ - INFO - Scraper youtube_intel completed: 8 results
2026-10-04 22:30:18,819 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-04 22:30:18.819148
2026-10-04 22:30:18,819 - __main__ - INFO - Email sent successfully
2026-10-04 22:30:18,819 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-04 22:30:18,819 - __main__ - INFO - Monitor complete. Found 10 total results: 2 new github results, 8 new youtube intel results.
2026-10-04 22:30:18,819 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-04 22:30:18,820 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 22:30:18,850 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-04 22:30:18,851 - __main__ - INFO - Closed all database connections
2026-10-04 22:30:18,853 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 22:30:18,853 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-04 23:00:01,691 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-04.log
2026-10-04 23:00:01,691 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-04.log
2026-10-04 23:00:01,691 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-04.log
2026-10-04 23:00:01,691 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-04 23:00:01,719 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-04 23:00:01,720 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-04 23:00:01,722 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-04 23:00:01,722 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-04 23:00:01,741 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-04 23:00:01,742 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-04 23:00:01,745 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-04 23:00:01,746 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-04 23:00:01,747 - __main__ - INFO - RSS scraper initialized and enabled
2026-10-04 23:00:01,751 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-04 23:00:01,751 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-04 23:00:01,751 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-10-04 23:00:01,755 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-04 23:00:01,762 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-04 23:00:01,762 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-04 23:00:01,766 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-04 23:00:01,766 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-04 23:00:01,766 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-04 23:00:01,770 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-04 23:00:01,770 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-10-04 23:00:01,770 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-04 23:00:01,771 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-10-04 23:00:01,890 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-10-04 23:00:01,895 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-10-04 23:00:01,895 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-10-04 23:00:01,898 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-10-04 23:00:02,236 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-10-04 23:00:02,650 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-10-04 23:00:02,657 - Yiddish24Scraper - INFO - Received response with 547139 characters
2026-10-04 23:00:02,662 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318839 chars)
2026-10-04 23:00:02,665 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-10-04 23:00:02,749 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-10-04 23:00:02,791 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-10-04 23:00:02,792 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-10-04 23:00:03,631 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-10-04 23:00:03,631 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-10-04 23:00:03,631 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-10-04 23:00:03,632 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-10-04 23:00:16,869 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-10-04 23:00:43,686 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-10-04 23:00:43,687 - IveltScraper - INFO - All forums scrape complete. Found 1 new posts.
2026-10-04 23:00:43,687 - __main__ - INFO - Scraper rss completed: 0 results
2026-10-04 23:00:43,687 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-10-04 23:00:43,687 - __main__ - INFO - Scraper ivelt completed: 1 results
2026-10-04 23:00:44,448 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-04 23:00:44.448676
2026-10-04 23:00:44,448 - __main__ - INFO - Email sent successfully
2026-10-04 23:00:44,449 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-04 23:00:44,449 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new ivelt results.
2026-10-04 23:00:44,449 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-04 23:00:44,449 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 23:00:44,666 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-04 23:00:44,666 - __main__ - INFO - Closed all database connections
2026-10-04 23:00:44,668 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-04 23:00:44,668 - social_media_monitor.database.connection - INFO - Closed 0 database connections