← Logs

social_media_monitor_2026-09-18.log

2026-09-18 20:00:54,425 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-18 20:00:54,425 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 20:00:54,604 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-18 20:00:54,604 - __main__ - INFO - Closed all database connections

2026-09-18 20:00:54,607 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 20:00:54,607 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-18 20:30:02,642 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-18.log

2026-09-18 20:30:02,642 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-18.log

2026-09-18 20:30:02,642 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-18.log

2026-09-18 20:30:02,642 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-18 20:30:02,672 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-18 20:30:02,673 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-18 20:30:02,675 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-18 20:30:02,676 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-18 20:30:02,689 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-18 20:30:02,689 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-18 20:30:02,695 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-18 20:30:02,696 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-18 20:30:02,697 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-18 20:30:02,697 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-18 20:30:02,703 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-18 20:30:02,703 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-18 20:30:02,709 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-18 20:30:02,716 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-18 20:30:02,716 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-18 20:30:02,718 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-18 20:30:02,718 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-18 20:30:02,718 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-18 20:30:02,720 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-18 20:30:02,721 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-18 20:30:02,721 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-18 20:30:02,721 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']

2026-09-18 20:30:03,147 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-18 20:30:03,147 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-18 20:30:03,815 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-18 20:30:03,841 - GitHubScraper - INFO - Found 614 GitHub repositories for term: "Hermes Agent"

2026-09-18 20:30:04,018 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-18 20:30:04,392 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-18 20:30:04,393 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"

2026-09-18 20:30:05,131 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-18 20:30:05,399 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-18 20:30:05,399 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"

2026-09-18 20:30:06,587 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:06,588 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)

2026-09-18 20:30:06,841 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-18 20:30:06,843 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"

2026-09-18 20:30:07,949 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-18 20:30:07,954 - GitHubScraper - INFO - Found 261 GitHub repositories for term: paperclip

2026-09-18 20:30:08,375 - GitHubScraper - INFO - Total GitHub results found: 0

2026-09-18 20:30:09,470 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-18 20:30:09,897 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 20:30:09,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:09,922 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 20:30:09,956 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:10,249 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:10,299 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:10,367 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:10,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 20:30:10,655 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:10,659 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:10,750 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:10,858 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:10,972 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:11,063 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:11,077 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:11,346 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:11,371 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:11,510 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:11,638 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 20:30:11,671 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:11,814 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:11,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:11,934 - YouTubeIntelScraper - INFO - YouTube Intel found 25 candidates and 5 new videos

2026-09-18 20:30:12,021 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:12,023 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:12,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:12,451 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:12,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:12,729 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:12,813 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:12,833 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:13,001 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:13,184 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:13,300 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:13,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 20:30:13,364 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:13,671 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:13,827 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:13,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:13,954 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:14,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:14,197 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:14,440 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:14,475 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:14,512 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 20:30:14,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:14,853 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:14,863 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:14,979 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:15,130 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 20:30:15,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:15,325 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:15,349 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:15,627 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:15,641 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:15,689 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:15,742 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:16,015 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:16,174 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:16,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 20:30:16,264 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 20:30:16,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:16,500 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:16,568 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:16,663 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:16,838 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:16,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:16,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:16,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:17,194 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:17,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:17,302 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:17,342 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:17,544 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:17,571 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:17,692 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:17,769 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:17,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:17,986 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,007 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,171 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,268 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,348 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,584 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,590 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,697 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,722 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,916 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,935 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:18,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:19,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:19,214 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:19,274 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:19,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:19,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:19,519 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:19,641 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:19,797 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:19,969 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:19,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 20:30:20,058 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-18 20:30:20,059 - __main__ - INFO - Scraper github completed: 0 results

2026-09-18 20:30:20,059 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-18 20:30:20,059 - __main__ - INFO - Scraper youtube_intel completed: 5 results

2026-09-18 20:30:20,724 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-18 20:30:20.724071

2026-09-18 20:30:20,724 - __main__ - INFO - Email sent successfully

2026-09-18 20:30:20,724 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-18 20:30:20,724 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new youtube intel results.

2026-09-18 20:30:20,724 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-18 20:30:20,725 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 20:30:20,748 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-18 20:30:20,749 - __main__ - INFO - Closed all database connections

2026-09-18 20:30:20,751 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 20:30:20,751 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-18 21:00:01,823 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-18.log

2026-09-18 21:00:01,824 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-18.log

2026-09-18 21:00:01,824 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-18.log

2026-09-18 21:00:01,824 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-18 21:00:01,855 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-18 21:00:01,855 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-18 21:00:01,858 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-18 21:00:01,858 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-18 21:00:01,874 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-18 21:00:01,874 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-18 21:00:01,880 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-18 21:00:01,882 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-18 21:00:01,883 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-18 21:00:01,890 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-18 21:00:01,890 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-18 21:00:01,890 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-18 21:00:01,893 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-18 21:00:01,899 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-18 21:00:01,899 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-18 21:00:01,902 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-18 21:00:01,902 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-18 21:00:01,902 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-18 21:00:01,904 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-18 21:00:01,904 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-18 21:00:01,905 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-18 21:00:01,905 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-18 21:00:01,998 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-18 21:00:02,002 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-18 21:00:02,002 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-18 21:00:02,004 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-18 21:00:02,321 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-18 21:00:04,355 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-18 21:00:04,581 - Yiddish24Scraper - INFO - Received response with 511621 characters

2026-09-18 21:00:04,584 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (316787 chars)

2026-09-18 21:00:04,587 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-18 21:00:04,665 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-18 21:00:04,704 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-18 21:00:04,705 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-18 21:00:05,533 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles

2026-09-18 21:00:05,534 - Yiddish24Scraper - INFO - Page 1: 6/100 new items

2026-09-18 21:00:05,534 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination

2026-09-18 21:00:05,534 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-09-18 21:00:14,291 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-18 21:00:38,487 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.

2026-09-18 21:00:38,488 - IveltScraper - INFO - All forums scrape complete. Found 11 new posts.

2026-09-18 21:00:38,488 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-18 21:00:38,488 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-09-18 21:00:38,488 - __main__ - INFO - Scraper ivelt completed: 11 results

2026-09-18 21:00:39,299 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-18 21:00:39.299100

2026-09-18 21:00:39,299 - __main__ - INFO - Email sent successfully

2026-09-18 21:00:39,299 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-18 21:00:39,299 - __main__ - INFO - Monitor complete. Found 17 total results: 6 new yiddish24 results, 11 new ivelt results.

2026-09-18 21:00:39,299 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-18 21:00:39,300 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 21:00:39,388 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-18 21:00:39,388 - __main__ - INFO - Closed all database connections

2026-09-18 21:00:39,391 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 21:00:39,392 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-18 22:00:01,623 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-18.log

2026-09-18 22:00:01,624 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-18.log

2026-09-18 22:00:01,624 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-18.log

2026-09-18 22:00:01,624 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-18 22:00:01,659 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-18 22:00:01,659 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-18 22:00:01,662 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-18 22:00:01,663 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-18 22:00:01,675 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-18 22:00:01,676 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-18 22:00:01,727 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-18 22:00:01,729 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-18 22:00:01,729 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-18 22:00:01,737 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-18 22:00:01,737 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-18 22:00:01,738 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-18 22:00:01,741 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-18 22:00:01,747 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-18 22:00:01,747 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-18 22:00:01,750 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-18 22:00:01,750 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-18 22:00:01,750 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-18 22:00:01,753 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-18 22:00:01,753 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-18 22:00:01,753 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-18 22:00:01,753 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-18 22:00:01,846 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-18 22:00:01,851 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-18 22:00:01,851 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-18 22:00:01,852 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-18 22:00:02,157 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-18 22:00:04,337 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-18 22:00:04,694 - Yiddish24Scraper - INFO - Received response with 511621 characters

2026-09-18 22:00:04,698 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (316787 chars)

2026-09-18 22:00:04,701 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-18 22:00:04,798 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-18 22:00:04,850 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-18 22:00:04,851 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-18 22:00:05,686 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-09-18 22:00:05,686 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-09-18 22:00:05,686 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-09-18 22:00:05,686 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-09-18 22:00:13,701 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-18 22:00:28,314 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-18 22:00:34,411 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.

2026-09-18 22:00:34,412 - IveltScraper - INFO - All forums scrape complete. Found 23 new posts.

2026-09-18 22:00:34,412 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-18 22:00:34,412 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-09-18 22:00:34,412 - __main__ - INFO - Scraper ivelt completed: 23 results

2026-09-18 22:00:35,228 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-18 22:00:35.228187

2026-09-18 22:00:35,228 - __main__ - INFO - Email sent successfully

2026-09-18 22:00:35,228 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-18 22:00:35,228 - __main__ - INFO - Monitor complete. Found 23 total results: 23 new ivelt results.

2026-09-18 22:00:35,229 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-18 22:00:35,229 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 22:00:35,269 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-18 22:00:35,269 - __main__ - INFO - Closed all database connections

2026-09-18 22:00:35,271 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 22:00:35,271 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-18 22:30:02,243 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-18.log

2026-09-18 22:30:02,243 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-18.log

2026-09-18 22:30:02,243 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-18.log

2026-09-18 22:30:02,243 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-18 22:30:02,272 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-18 22:30:02,272 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-18 22:30:02,274 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-18 22:30:02,275 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-18 22:30:02,291 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-18 22:30:02,291 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-18 22:30:02,296 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-18 22:30:02,297 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-18 22:30:02,297 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-18 22:30:02,298 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-18 22:30:02,302 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-18 22:30:02,302 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-18 22:30:02,308 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-18 22:30:02,312 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-18 22:30:02,312 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-18 22:30:02,314 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-18 22:30:02,315 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-18 22:30:02,315 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-18 22:30:02,317 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-18 22:30:02,318 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-18 22:30:02,318 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-18 22:30:02,318 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']

2026-09-18 22:30:02,795 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-18 22:30:02,796 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-18 22:30:03,644 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-18 22:30:03,738 - GitHubScraper - INFO - Found 615 GitHub repositories for term: "Hermes Agent"

2026-09-18 22:30:03,977 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-18 22:30:04,358 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-18 22:30:04,358 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"

2026-09-18 22:30:05,190 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-18 22:30:05,545 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-18 22:30:05,546 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"

2026-09-18 22:30:06,518 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:06,519 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)

2026-09-18 22:30:06,920 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-18 22:30:07,000 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"

2026-09-18 22:30:08,455 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-18 22:30:08,548 - GitHubScraper - INFO - Found 261 GitHub repositories for term: paperclip

2026-09-18 22:30:08,701 - GitHubScraper - INFO - Total GitHub results found: 0

2026-09-18 22:30:09,239 - YouTubeIntelScraper - INFO - YouTube Intel found 25 candidates and 1 new videos

2026-09-18 22:30:09,809 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-18 22:30:10,160 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:10,210 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:10,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:10,256 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:10,509 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:10,530 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:10,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:10,633 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:10,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:10,910 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:10,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:11,173 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:11,177 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:11,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:11,524 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:11,631 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:11,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:11,713 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:11,948 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:11,953 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:12,007 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:12,052 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:12,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:12,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:12,439 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:12,498 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:12,757 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:12,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:12,851 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:12,977 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:13,055 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:13,298 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:13,338 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:13,399 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:13,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:13,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:13,803 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:13,905 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:13,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:13,936 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:14,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:14,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:14,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:14,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:14,460 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:14,798 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:14,814 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:14,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:14,966 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:15,138 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:15,265 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:15,280 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:15,305 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:15,588 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:15,607 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:15,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:15,845 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:16,052 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-18 22:30:16,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:16,273 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:16,373 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:16,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:16,483 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:16,640 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:16,723 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:16,752 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:16,861 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:16,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:17,167 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:17,182 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:17,214 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:17,409 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:17,506 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:17,610 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:17,702 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:17,766 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:17,841 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:17,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:18,117 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:18,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:18,192 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:18,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:18,445 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:18,601 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:18,604 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:18,659 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:18,807 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:18,955 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,012 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,023 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,351 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,364 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,738 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:19,844 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:20,031 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-18 22:30:20,163 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-18 22:30:20,164 - __main__ - INFO - Scraper github completed: 0 results

2026-09-18 22:30:20,164 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-18 22:30:20,164 - __main__ - INFO - Scraper youtube_intel completed: 1 results

2026-09-18 22:30:20,733 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-18 22:30:20.733039

2026-09-18 22:30:20,733 - __main__ - INFO - Email sent successfully

2026-09-18 22:30:20,733 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-18 22:30:20,733 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new youtube intel results.

2026-09-18 22:30:20,733 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-18 22:30:20,733 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 22:30:20,784 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-18 22:30:20,785 - __main__ - INFO - Closed all database connections

2026-09-18 22:30:20,787 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 22:30:20,787 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-18 23:00:01,637 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-18.log

2026-09-18 23:00:01,638 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-18.log

2026-09-18 23:00:01,638 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-18.log

2026-09-18 23:00:01,638 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-18 23:00:01,667 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-18 23:00:01,667 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-18 23:00:01,669 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-18 23:00:01,670 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-18 23:00:01,686 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-18 23:00:01,686 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-18 23:00:01,690 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-18 23:00:01,692 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-18 23:00:01,692 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-18 23:00:01,697 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-18 23:00:01,697 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-18 23:00:01,697 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-18 23:00:01,703 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-18 23:00:01,709 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-18 23:00:01,709 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-18 23:00:01,712 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-18 23:00:01,712 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-18 23:00:01,712 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-18 23:00:01,714 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-18 23:00:01,714 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-18 23:00:01,714 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-18 23:00:01,715 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-18 23:00:01,830 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-18 23:00:01,835 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-18 23:00:01,835 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-18 23:00:01,837 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-18 23:00:02,154 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-18 23:00:05,271 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-18 23:00:05,501 - Yiddish24Scraper - INFO - Received response with 507519 characters

2026-09-18 23:00:05,505 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (314957 chars)

2026-09-18 23:00:05,508 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-18 23:00:05,593 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-18 23:00:05,636 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-18 23:00:05,636 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-18 23:00:06,322 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles

2026-09-18 23:00:06,322 - Yiddish24Scraper - INFO - Page 1: 1/100 new items

2026-09-18 23:00:06,322 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination

2026-09-18 23:00:06,323 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1

2026-09-18 23:00:13,505 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-18 23:00:34,361 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-18 23:00:34,966 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-09-18 23:00:34,966 - IveltScraper - INFO - All forums scrape complete. Found 8 new posts.

2026-09-18 23:00:34,966 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-18 23:00:34,966 - __main__ - INFO - Scraper yiddish24 completed: 1 results

2026-09-18 23:00:34,966 - __main__ - INFO - Scraper ivelt completed: 8 results

2026-09-18 23:00:35,645 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-18 23:00:35.645934

2026-09-18 23:00:35,646 - __main__ - INFO - Email sent successfully

2026-09-18 23:00:35,646 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-18 23:00:35,646 - __main__ - INFO - Monitor complete. Found 9 total results: 1 new yiddish24 results, 8 new ivelt results.

2026-09-18 23:00:35,646 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-18 23:00:35,646 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 23:00:35,700 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-18 23:00:35,700 - __main__ - INFO - Closed all database connections

2026-09-18 23:00:35,702 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-18 23:00:35,702 - social_media_monitor.database.connection - INFO - Closed 0 database connections