← Logs

social_media_monitor_2026-10-02.log

2026-10-02 20:00:41,805 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-02 20:00:41,805 - __main__ - INFO - Monitor complete. Found 7 total results: 3 new yiddish24 results, 4 new ivelt results.
2026-10-02 20:00:41,805 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-02 20:00:41,805 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 20:00:41,890 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-02 20:00:41,891 - __main__ - INFO - Closed all database connections
2026-10-02 20:00:41,893 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 20:00:41,893 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-02 20:30:02,552 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-02.log
2026-10-02 20:30:02,552 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-02.log
2026-10-02 20:30:02,552 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-02.log
2026-10-02 20:30:02,552 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-02 20:30:02,582 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-02 20:30:02,582 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-02 20:30:02,585 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-02 20:30:02,585 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-02 20:30:02,600 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-02 20:30:02,600 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-02 20:30:02,605 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-02 20:30:02,606 - __main__ - INFO - GitHub scraper initialized and enabled
2026-10-02 20:30:02,606 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-10-02 20:30:02,607 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-02 20:30:02,612 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-02 20:30:02,612 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-02 20:30:02,616 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-02 20:30:02,621 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-02 20:30:02,621 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-02 20:30:02,623 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-02 20:30:02,623 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-02 20:30:02,624 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-02 20:30:02,626 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-02 20:30:02,626 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-10-02 20:30:02,626 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-02 20:30:02,626 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-10-02 20:30:03,048 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-10-02 20:30:03,049 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-10-02 20:30:03,909 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-02 20:30:03,935 - GitHubScraper - INFO - Found 662 GitHub repositories for term: "Hermes Agent"
2026-10-02 20:30:04,082 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-10-02 20:30:04,507 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-02 20:30:04,507 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-10-02 20:30:04,910 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-10-02 20:30:05,577 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-02 20:30:05,577 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-10-02 20:30:06,049 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:06,050 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-10-02 20:30:06,986 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-02 20:30:06,990 - GitHubScraper - INFO - Found 44 GitHub repositories for term: "prime agent"
2026-10-02 20:30:08,745 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-10-02 20:30:08,780 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-02 20:30:08,784 - GitHubScraper - INFO - Found 269 GitHub repositories for term: paperclip
2026-10-02 20:30:08,830 - GitHubScraper - INFO - Added new GitHub repository: awesome-multi-agent-orchestrators
2026-10-02 20:30:08,932 - GitHubScraper - INFO - Total GitHub results found: 1
2026-10-02 20:30:09,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:09,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:09,392 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:09,478 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:09,640 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 20:30:09,667 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:09,821 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:09,823 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:10,024 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:10,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:10,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:10,211 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:10,389 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:10,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:10,558 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:10,802 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:10,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:10,941 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 20:30:11,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:11,136 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:11,353 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:11,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:11,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:11,538 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 20:30:11,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:11,974 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:11,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:12,014 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:12,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:12,425 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:12,435 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:12,554 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:12,772 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:12,794 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:13,023 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 20:30:13,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 20:30:13,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:13,630 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:13,641 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 20:30:13,663 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:13,753 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:13,978 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:14,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:14,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:14,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:14,349 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:14,450 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:14,479 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:14,735 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:14,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:14,876 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:14,920 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:15,183 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:15,196 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:15,235 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:15,523 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:15,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 20:30:15,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 20:30:15,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,035 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,136 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,192 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,196 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,393 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,486 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,551 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,901 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,926 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:16,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,098 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,230 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,248 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,286 - YouTubeIntelScraper - INFO - YouTube Intel found 35 candidates and 8 new videos
2026-10-02 20:30:17,324 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,408 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,673 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,903 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,956 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:17,983 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:18,031 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:18,365 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:18,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:18,443 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:18,540 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:18,667 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:18,753 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:18,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:18,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:19,037 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:19,048 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:19,164 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:19,255 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:19,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:19,406 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:19,651 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:19,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:19,908 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 20:30:19,975 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-10-02 20:30:19,976 - __main__ - INFO - Scraper github completed: 1 results
2026-10-02 20:30:19,976 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-10-02 20:30:19,976 - __main__ - INFO - Scraper youtube_intel completed: 8 results
2026-10-02 20:30:22,418 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-02 20:30:22.418143
2026-10-02 20:30:22,418 - __main__ - INFO - Email sent successfully
2026-10-02 20:30:22,418 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-02 20:30:22,418 - __main__ - INFO - Monitor complete. Found 9 total results: 1 new github results, 8 new youtube intel results.
2026-10-02 20:30:22,418 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-02 20:30:22,418 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 20:30:22,512 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-02 20:30:22,512 - __main__ - INFO - Closed all database connections
2026-10-02 20:30:22,514 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 20:30:22,514 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-02 21:00:02,132 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-02.log
2026-10-02 21:00:02,133 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-02.log
2026-10-02 21:00:02,133 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-02.log
2026-10-02 21:00:02,133 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-02 21:00:02,164 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-02 21:00:02,164 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-02 21:00:02,167 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-02 21:00:02,167 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-02 21:00:02,186 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-02 21:00:02,186 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-02 21:00:02,194 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-02 21:00:02,196 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-02 21:00:02,196 - __main__ - INFO - RSS scraper initialized and enabled
2026-10-02 21:00:02,202 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-02 21:00:02,202 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-02 21:00:02,203 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-10-02 21:00:02,207 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-02 21:00:02,213 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-02 21:00:02,213 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-02 21:00:02,215 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-02 21:00:02,216 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-02 21:00:02,216 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-02 21:00:02,218 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-02 21:00:02,218 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-10-02 21:00:02,219 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-02 21:00:02,219 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-10-02 21:00:02,357 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-10-02 21:00:02,363 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-10-02 21:00:02,364 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-10-02 21:00:02,365 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-10-02 21:00:02,593 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-10-02 21:00:03,914 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-10-02 21:00:04,170 - Yiddish24Scraper - INFO - Received response with 547139 characters
2026-10-02 21:00:04,173 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318839 chars)
2026-10-02 21:00:04,177 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-10-02 21:00:04,272 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-10-02 21:00:04,321 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-10-02 21:00:04,321 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-10-02 21:00:05,130 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles
2026-10-02 21:00:05,130 - Yiddish24Scraper - INFO - Page 1: 3/100 new items
2026-10-02 21:00:05,131 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination
2026-10-02 21:00:05,131 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3
2026-10-02 21:00:14,705 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-10-02 21:00:37,026 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-10-02 21:00:37,026 - IveltScraper - INFO - All forums scrape complete. Found 8 new posts.
2026-10-02 21:00:37,027 - __main__ - INFO - Scraper rss completed: 0 results
2026-10-02 21:00:37,027 - __main__ - INFO - Scraper yiddish24 completed: 3 results
2026-10-02 21:00:37,027 - __main__ - INFO - Scraper ivelt completed: 8 results
2026-10-02 21:00:42,508 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-02 21:00:42.508905
2026-10-02 21:00:42,509 - __main__ - INFO - Email sent successfully
2026-10-02 21:00:42,512 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-02 21:00:42,512 - __main__ - INFO - Monitor complete. Found 11 total results: 3 new yiddish24 results, 8 new ivelt results.
2026-10-02 21:00:42,512 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-02 21:00:42,512 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 21:00:42,601 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-02 21:00:42,602 - __main__ - INFO - Closed all database connections
2026-10-02 21:00:42,603 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 21:00:42,604 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-02 22:00:02,203 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-02.log
2026-10-02 22:00:02,203 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-02.log
2026-10-02 22:00:02,204 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-02.log
2026-10-02 22:00:02,204 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-02 22:00:02,234 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-02 22:00:02,234 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-02 22:00:02,237 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-02 22:00:02,237 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-02 22:00:02,251 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-02 22:00:02,251 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-02 22:00:02,302 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-02 22:00:02,304 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-02 22:00:02,304 - __main__ - INFO - RSS scraper initialized and enabled
2026-10-02 22:00:02,312 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-02 22:00:02,312 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-02 22:00:02,312 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-10-02 22:00:02,317 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-02 22:00:02,325 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-02 22:00:02,325 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-02 22:00:02,327 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-02 22:00:02,327 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-02 22:00:02,328 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-02 22:00:02,330 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-02 22:00:02,330 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-10-02 22:00:02,330 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-02 22:00:02,331 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-10-02 22:00:02,436 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-10-02 22:00:02,441 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-10-02 22:00:02,441 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-10-02 22:00:02,443 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-10-02 22:00:02,715 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-10-02 22:00:03,126 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-10-02 22:00:03,357 - Yiddish24Scraper - INFO - Received response with 547139 characters
2026-10-02 22:00:03,359 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318839 chars)
2026-10-02 22:00:03,362 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-10-02 22:00:03,446 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-10-02 22:00:03,487 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-10-02 22:00:03,487 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-10-02 22:00:04,309 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-10-02 22:00:04,309 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-10-02 22:00:04,309 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-10-02 22:00:04,309 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-10-02 22:00:14,773 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-10-02 22:00:34,717 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-10-02 22:00:34,717 - IveltScraper - INFO - All forums scrape complete. Found 5 new posts.
2026-10-02 22:00:34,717 - __main__ - INFO - Scraper rss completed: 0 results
2026-10-02 22:00:34,717 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-10-02 22:00:34,717 - __main__ - INFO - Scraper ivelt completed: 5 results
2026-10-02 22:00:40,148 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-02 22:00:40.148496
2026-10-02 22:00:40,148 - __main__ - INFO - Email sent successfully
2026-10-02 22:00:40,156 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-02 22:00:40,156 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new ivelt results.
2026-10-02 22:00:40,156 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-02 22:00:40,156 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 22:00:40,400 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-02 22:00:40,400 - __main__ - INFO - Closed all database connections
2026-10-02 22:00:40,402 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 22:00:40,402 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-02 22:30:02,060 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-02.log
2026-10-02 22:30:02,060 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-02.log
2026-10-02 22:30:02,060 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-02.log
2026-10-02 22:30:02,060 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-02 22:30:02,093 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-02 22:30:02,093 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-02 22:30:02,096 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-02 22:30:02,096 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-02 22:30:02,113 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-02 22:30:02,113 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-02 22:30:02,118 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-02 22:30:02,119 - __main__ - INFO - GitHub scraper initialized and enabled
2026-10-02 22:30:02,119 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-10-02 22:30:02,120 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-02 22:30:02,125 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-02 22:30:02,125 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-02 22:30:02,130 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-02 22:30:02,135 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-02 22:30:02,135 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-02 22:30:02,137 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-02 22:30:02,137 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-02 22:30:02,138 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-02 22:30:02,140 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-02 22:30:02,140 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-10-02 22:30:02,140 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-02 22:30:02,140 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-10-02 22:30:02,576 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-10-02 22:30:02,577 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-10-02 22:30:03,213 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-02 22:30:03,239 - GitHubScraper - INFO - Found 662 GitHub repositories for term: "Hermes Agent"
2026-10-02 22:30:03,340 - GitHubScraper - INFO - Added new GitHub repository: ThinkWatch-Lite
2026-10-02 22:30:03,595 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:03,595 - GitHubFeedScraper - INFO - GitHub account feed page 1 unchanged (ETag)
2026-10-02 22:30:03,785 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-02 22:30:03,786 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-10-02 22:30:04,753 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-02 22:30:04,754 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-10-02 22:30:06,349 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-02 22:30:06,352 - GitHubScraper - INFO - Found 44 GitHub repositories for term: "prime agent"
2026-10-02 22:30:07,079 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-10-02 22:30:07,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:07,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:07,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:07,592 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:07,645 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-10-02 22:30:07,646 - GitHubScraper - INFO - Found 269 GitHub repositories for term: paperclip
2026-10-02 22:30:07,786 - GitHubScraper - INFO - Total GitHub results found: 1
2026-10-02 22:30:07,871 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:07,905 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:07,933 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:07,965 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:08,242 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:08,266 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:08,297 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:08,331 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:08,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:08,677 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:08,748 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:08,858 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 22:30:09,014 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:09,114 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:09,212 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:09,224 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:09,434 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:09,534 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:09,570 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:09,628 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,046 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,114 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,169 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,418 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,587 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,653 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,757 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:10,894 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:11,079 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:11,126 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:11,235 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:11,283 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:11,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:11,564 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:11,579 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:11,658 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:11,971 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 22:30:12,019 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:12,037 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:12,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:12,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:12,603 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:12,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:12,808 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:12,994 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:13,068 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:13,126 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:13,325 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:13,522 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:13,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-10-02 22:30:13,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:13,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:13,952 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:14,016 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:14,089 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:14,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:14,337 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:14,455 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:14,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:14,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:14,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:14,838 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:14,924 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,052 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,125 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,152 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,233 - YouTubeIntelScraper - INFO - YouTube Intel found 37 candidates and 9 new videos
2026-10-02 22:30:15,416 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,463 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,506 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,522 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,803 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,828 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,837 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:15,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,177 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,189 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,206 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,450 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,726 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,813 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,875 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:16,926 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:17,033 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:17,157 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:17,263 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:17,349 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:17,356 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:17,533 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:17,685 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:17,936 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-10-02 22:30:17,958 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=0 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-10-02 22:30:17,959 - __main__ - INFO - Scraper github completed: 1 results
2026-10-02 22:30:17,959 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-10-02 22:30:17,960 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-10-02 22:30:19,146 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-02 22:30:19.146525
2026-10-02 22:30:19,146 - __main__ - INFO - Email sent successfully
2026-10-02 22:30:19,147 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-02 22:30:19,147 - __main__ - INFO - Monitor complete. Found 10 total results: 1 new github results, 9 new youtube intel results.
2026-10-02 22:30:19,147 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-02 22:30:19,147 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 22:30:19,169 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-02 22:30:19,170 - __main__ - INFO - Closed all database connections
2026-10-02 22:30:19,172 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 22:30:19,172 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-10-02 23:00:02,654 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-02.log
2026-10-02 23:00:02,654 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-02.log
2026-10-02 23:00:02,654 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-02.log
2026-10-02 23:00:02,654 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-10-02 23:00:02,682 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-10-02 23:00:02,682 - __main__ - INFO - Configuration loaded and validated successfully
2026-10-02 23:00:02,685 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-10-02 23:00:02,685 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-10-02 23:00:02,700 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-10-02 23:00:02,700 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-10-02 23:00:02,753 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-10-02 23:00:02,755 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-10-02 23:00:02,755 - __main__ - INFO - RSS scraper initialized and enabled
2026-10-02 23:00:02,763 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-10-02 23:00:02,763 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-10-02 23:00:02,763 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-10-02 23:00:02,768 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-10-02 23:00:02,776 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-10-02 23:00:02,776 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-10-02 23:00:02,779 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-10-02 23:00:02,779 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-10-02 23:00:02,779 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-10-02 23:00:02,781 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-10-02 23:00:02,781 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-10-02 23:00:02,782 - __main__ - INFO - Running 3 scrapers concurrently...
2026-10-02 23:00:02,782 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-10-02 23:00:02,871 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-10-02 23:00:02,876 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-10-02 23:00:02,876 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-10-02 23:00:02,878 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-10-02 23:00:03,135 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-10-02 23:00:03,631 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-10-02 23:00:03,864 - Yiddish24Scraper - INFO - Received response with 547139 characters
2026-10-02 23:00:03,868 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318839 chars)
2026-10-02 23:00:03,871 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-10-02 23:00:03,949 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-10-02 23:00:04,003 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-10-02 23:00:04,003 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-10-02 23:00:04,907 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-10-02 23:00:04,907 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-10-02 23:00:04,908 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-10-02 23:00:04,908 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-10-02 23:00:15,192 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-10-02 23:00:35,506 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-10-02 23:00:35,507 - IveltScraper - INFO - All forums scrape complete. Found 2 new posts.
2026-10-02 23:00:35,507 - __main__ - INFO - Scraper rss completed: 0 results
2026-10-02 23:00:35,507 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-10-02 23:00:35,507 - __main__ - INFO - Scraper ivelt completed: 2 results
2026-10-02 23:00:38,301 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-02 23:00:38.300963
2026-10-02 23:00:38,301 - __main__ - INFO - Email sent successfully
2026-10-02 23:00:38,301 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-10-02 23:00:38,301 - __main__ - INFO - Monitor complete. Found 2 total results: 2 new ivelt results.
2026-10-02 23:00:38,301 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-10-02 23:00:38,302 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 23:00:38,389 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-10-02 23:00:38,389 - __main__ - INFO - Closed all database connections
2026-10-02 23:00:38,391 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-10-02 23:00:38,391 - social_media_monitor.database.connection - INFO - Closed 0 database connections