← Logs

social_media_monitor_2026-09-29.log

2026-09-29 20:00:36,893 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-29 20:30:01,662 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-29.log

2026-09-29 20:30:01,663 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-29.log

2026-09-29 20:30:01,663 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-29.log

2026-09-29 20:30:01,663 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-29 20:30:01,705 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-29 20:30:01,706 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-29 20:30:01,708 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-29 20:30:01,709 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-29 20:30:01,724 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-29 20:30:01,724 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-29 20:30:01,728 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-29 20:30:01,729 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-29 20:30:01,730 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-29 20:30:01,730 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-29 20:30:01,737 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-29 20:30:01,737 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-29 20:30:01,742 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-29 20:30:01,749 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-29 20:30:01,749 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-29 20:30:01,752 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-29 20:30:01,752 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-29 20:30:01,752 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-29 20:30:01,754 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-29 20:30:01,754 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-29 20:30:01,754 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-29 20:30:01,755 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']

2026-09-29 20:30:02,176 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-29 20:30:02,176 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-29 20:30:03,004 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-29 20:30:03,032 - GitHubScraper - INFO - Found 651 GitHub repositories for term: "Hermes Agent"

2026-09-29 20:30:03,177 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-29 20:30:03,584 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-29 20:30:03,585 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"

2026-09-29 20:30:04,377 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-29 20:30:04,611 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-29 20:30:04,612 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"

2026-09-29 20:30:05,975 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"

2026-09-29 20:30:06,159 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-29 20:30:06,253 - GitHubScraper - INFO - Found 44 GitHub repositories for term: "prime agent"

2026-09-29 20:30:07,453 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-29 20:30:07,457 - GitHubScraper - INFO - Found 267 GitHub repositories for term: paperclip

2026-09-29 20:30:08,659 - GitHubScraper - INFO - Total GitHub results found: 0

2026-09-29 20:30:09,834 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-29 20:30:10,298 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:10,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:10,316 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:10,430 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:10,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:10,685 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:10,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:10,819 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,019 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,055 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,107 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,224 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,388 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,424 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,522 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,600 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,833 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:11,953 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 20:30:12,014 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:12,220 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:12,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:12,289 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:12,467 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:12,566 - YouTubeIntelScraper - INFO - YouTube Intel found 32 candidates and 7 new videos

2026-09-29 20:30:12,796 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:12,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:12,897 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:13,099 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:13,197 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:13,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:13,578 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:13,590 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:13,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:13,940 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:13,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 20:30:14,255 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:14,434 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 20:30:14,448 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:14,599 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:14,807 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:14,886 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:14,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 20:30:14,965 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:15,170 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:15,352 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:15,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:15,421 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:15,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:15,714 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:15,862 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:16,002 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:16,043 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:16,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:16,305 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:16,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:16,538 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:16,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 20:30:16,855 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:16,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,165 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,192 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,244 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,522 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,554 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,570 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,677 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,905 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,947 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:17,967 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:18,095 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:18,298 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:18,370 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:18,434 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:18,453 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:18,714 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:18,728 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:18,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:18,832 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,137 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,165 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,175 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,212 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,446 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,530 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,630 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,806 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,816 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,871 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:19,986 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:20,167 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:20,181 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:20,267 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:20,291 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:20,546 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:20,557 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:20,770 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:20,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 20:30:21,016 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 20:30:21,056 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1

2026-09-29 20:30:21,057 - __main__ - INFO - Scraper github completed: 0 results

2026-09-29 20:30:21,058 - __main__ - INFO - Scraper github_feed completed: 1 results

2026-09-29 20:30:21,058 - __main__ - INFO - Scraper youtube_intel completed: 7 results

2026-09-29 20:30:23,186 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-29 20:30:23.186715

2026-09-29 20:30:23,187 - __main__ - INFO - Email sent successfully

2026-09-29 20:30:23,195 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed

2026-09-29 20:30:23,196 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-29 20:30:23,196 - __main__ - INFO - Monitor complete. Found 8 total results: 1 new github feed results, 7 new youtube intel results.

2026-09-29 20:30:23,196 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-29 20:30:23,196 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-29 20:30:23,223 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-29 20:30:23,223 - __main__ - INFO - Closed all database connections

2026-09-29 20:30:23,226 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-29 20:30:23,226 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-29 21:00:02,137 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-29.log

2026-09-29 21:00:02,137 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-29.log

2026-09-29 21:00:02,137 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-29.log

2026-09-29 21:00:02,137 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-29 21:00:02,167 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-29 21:00:02,167 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-29 21:00:02,170 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-29 21:00:02,171 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-29 21:00:02,188 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-29 21:00:02,189 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-29 21:00:02,193 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-29 21:00:02,195 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-29 21:00:02,195 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-29 21:00:02,200 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-29 21:00:02,200 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-29 21:00:02,201 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-29 21:00:02,206 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-29 21:00:02,211 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-29 21:00:02,212 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-29 21:00:02,214 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-29 21:00:02,214 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-29 21:00:02,214 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-29 21:00:02,217 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-29 21:00:02,217 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-29 21:00:02,217 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-29 21:00:02,217 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-29 21:00:02,311 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-29 21:00:02,316 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters

2026-09-29 21:00:02,316 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-29 21:00:02,320 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-29 21:00:02,691 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-29 21:00:03,846 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-29 21:00:04,077 - Yiddish24Scraper - INFO - Received response with 530714 characters

2026-09-29 21:00:04,081 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (320572 chars)

2026-09-29 21:00:04,084 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-29 21:00:04,161 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-29 21:00:04,201 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-29 21:00:04,201 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-29 21:00:04,979 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles

2026-09-29 21:00:04,980 - Yiddish24Scraper - INFO - Page 1: 3/100 new items

2026-09-29 21:00:04,980 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination

2026-09-29 21:00:04,980 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3

2026-09-29 21:00:14,349 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-29 21:00:33,121 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.

2026-09-29 21:00:33,121 - IveltScraper - INFO - All forums scrape complete. Found 14 new posts.

2026-09-29 21:00:33,122 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-29 21:00:33,122 - __main__ - INFO - Scraper yiddish24 completed: 3 results

2026-09-29 21:00:33,122 - __main__ - INFO - Scraper ivelt completed: 14 results

2026-09-29 21:00:34,554 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-29 21:00:34.554323

2026-09-29 21:00:34,554 - __main__ - INFO - Email sent successfully

2026-09-29 21:00:34,555 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-29 21:00:34,555 - __main__ - INFO - Monitor complete. Found 17 total results: 3 new yiddish24 results, 14 new ivelt results.

2026-09-29 21:00:34,555 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-29 21:00:34,555 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-29 21:00:34,606 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-29 21:00:34,606 - __main__ - INFO - Closed all database connections

2026-09-29 21:00:34,609 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-29 21:00:34,609 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-29 22:00:01,932 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-29.log

2026-09-29 22:00:01,933 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-29.log

2026-09-29 22:00:01,933 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-29.log

2026-09-29 22:00:01,933 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-29 22:00:01,963 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-29 22:00:01,963 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-29 22:00:01,965 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-29 22:00:01,966 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-29 22:00:01,986 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-29 22:00:01,986 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-29 22:00:02,044 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-29 22:00:02,045 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-29 22:00:02,045 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-29 22:00:02,050 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-29 22:00:02,051 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-29 22:00:02,051 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-29 22:00:02,053 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-29 22:00:02,058 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-29 22:00:02,058 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-29 22:00:02,060 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-29 22:00:02,060 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-29 22:00:02,060 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-29 22:00:02,062 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-29 22:00:02,063 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-29 22:00:02,063 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-29 22:00:02,063 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-29 22:00:02,175 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-29 22:00:02,181 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters

2026-09-29 22:00:02,181 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-29 22:00:02,183 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-29 22:00:02,499 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-29 22:00:05,491 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-29 22:00:05,725 - Yiddish24Scraper - INFO - Received response with 536891 characters

2026-09-29 22:00:05,727 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (322878 chars)

2026-09-29 22:00:05,729 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-29 22:00:05,814 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-29 22:00:05,856 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-29 22:00:05,856 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-29 22:00:06,775 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles

2026-09-29 22:00:06,775 - Yiddish24Scraper - INFO - Page 1: 3/100 new items

2026-09-29 22:00:06,775 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination

2026-09-29 22:00:06,775 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3

2026-09-29 22:00:14,654 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-29 22:00:26,671 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.

2026-09-29 22:00:26,671 - IveltScraper - INFO - All forums scrape complete. Found 4 new posts.

2026-09-29 22:00:26,672 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-29 22:00:26,672 - __main__ - INFO - Scraper yiddish24 completed: 3 results

2026-09-29 22:00:26,672 - __main__ - INFO - Scraper ivelt completed: 4 results

2026-09-29 22:00:28,402 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-29 22:00:28.402730

2026-09-29 22:00:28,403 - __main__ - INFO - Email sent successfully

2026-09-29 22:00:28,403 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-29 22:00:28,403 - __main__ - INFO - Monitor complete. Found 7 total results: 3 new yiddish24 results, 4 new ivelt results.

2026-09-29 22:00:28,403 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-29 22:00:28,403 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-29 22:00:28,466 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-29 22:00:28,467 - __main__ - INFO - Closed all database connections

2026-09-29 22:00:28,468 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-29 22:00:28,469 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-29 22:30:02,554 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-29.log

2026-09-29 22:30:02,554 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-29.log

2026-09-29 22:30:02,554 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-29.log

2026-09-29 22:30:02,554 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-29 22:30:02,584 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-29 22:30:02,584 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-29 22:30:02,586 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-29 22:30:02,587 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-29 22:30:02,600 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-29 22:30:02,600 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-29 22:30:02,606 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-29 22:30:02,607 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-29 22:30:02,608 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-29 22:30:02,608 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-29 22:30:02,616 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-29 22:30:02,616 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-29 22:30:02,619 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-29 22:30:02,624 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-29 22:30:02,624 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-29 22:30:02,626 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-29 22:30:02,626 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-29 22:30:02,627 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-29 22:30:02,629 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-29 22:30:02,629 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-29 22:30:02,629 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-29 22:30:02,629 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']

2026-09-29 22:30:03,088 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-29 22:30:03,088 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-29 22:30:03,991 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-29 22:30:04,083 - GitHubScraper - INFO - Found 651 GitHub repositories for term: "Hermes Agent"

2026-09-29 22:30:04,303 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-29 22:30:05,014 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-29 22:30:05,014 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"

2026-09-29 22:30:05,709 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-29 22:30:05,710 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"

2026-09-29 22:30:06,051 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-29 22:30:07,259 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-29 22:30:07,263 - GitHubScraper - INFO - Found 44 GitHub repositories for term: "prime agent"

2026-09-29 22:30:07,471 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"

2026-09-29 22:30:08,559 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-29 22:30:08,563 - GitHubScraper - INFO - Found 267 GitHub repositories for term: paperclip

2026-09-29 22:30:08,890 - GitHubScraper - INFO - Total GitHub results found: 0

2026-09-29 22:30:10,770 - YouTubeIntelScraper - INFO - YouTube Intel found 33 candidates and 4 new videos

2026-09-29 22:30:11,225 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-29 22:30:11,661 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:11,668 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:11,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:11,756 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:11,991 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:12,067 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:12,211 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:12,291 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:12,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:12,506 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:12,564 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:12,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:12,845 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:12,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:13,179 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:13,261 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:13,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:13,556 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:13,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:13,654 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:13,886 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:13,920 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:14,111 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:14,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:14,456 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:14,500 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:14,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:14,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:14,829 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:14,896 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:15,254 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:15,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:15,332 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:15,346 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:15,773 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:15,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:15,815 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:15,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:16,068 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:16,273 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:16,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:16,444 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:16,498 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:16,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:16,839 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:16,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:17,179 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:17,262 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:17,479 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:17,599 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:17,872 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:17,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:18,021 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:18,244 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:18,512 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:18,551 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:18,633 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:18,862 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:19,014 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:19,067 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:19,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:19,257 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:19,452 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:19,489 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:19,524 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:19,611 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:19,837 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:19,910 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:19,978 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:20,078 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:20,310 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:20,322 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:20,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:20,421 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:20,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:20,610 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:20,759 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:20,987 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:21,034 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:21,040 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:21,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:21,341 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:21,359 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:21,496 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:21,567 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:21,670 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:21,806 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:21,866 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:21,987 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:22,048 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:22,174 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:22,360 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:22,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:22,482 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:22,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:22,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:23,003 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:23,225 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-29 22:30:23,258 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:23,808 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-29 22:30:23,927 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-29 22:30:23,929 - __main__ - INFO - Scraper github completed: 0 results

2026-09-29 22:30:23,929 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-29 22:30:23,929 - __main__ - INFO - Scraper youtube_intel completed: 4 results

2026-09-29 22:30:25,925 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-29 22:30:25.924961

2026-09-29 22:30:25,925 - __main__ - INFO - Email sent successfully

2026-09-29 22:30:25,925 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-29 22:30:25,925 - __main__ - INFO - Monitor complete. Found 4 total results: 4 new youtube intel results.

2026-09-29 22:30:25,925 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-29 22:30:25,926 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-29 22:30:25,962 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-29 22:30:25,962 - __main__ - INFO - Closed all database connections

2026-09-29 22:30:25,965 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-29 22:30:25,965 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-29 23:00:02,132 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-29.log

2026-09-29 23:00:02,132 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-29.log

2026-09-29 23:00:02,132 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-29.log

2026-09-29 23:00:02,132 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-29 23:00:02,166 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-29 23:00:02,166 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-29 23:00:02,169 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-29 23:00:02,169 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-29 23:00:02,184 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-29 23:00:02,185 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-29 23:00:02,242 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-29 23:00:02,244 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-29 23:00:02,244 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-29 23:00:02,253 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-29 23:00:02,253 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-29 23:00:02,253 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-29 23:00:02,258 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-29 23:00:02,264 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-29 23:00:02,264 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-29 23:00:02,267 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-29 23:00:02,267 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-29 23:00:02,268 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-29 23:00:02,270 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-29 23:00:02,270 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-29 23:00:02,270 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-29 23:00:02,271 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-29 23:00:02,382 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-29 23:00:02,387 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters

2026-09-29 23:00:02,387 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-29 23:00:02,390 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-29 23:00:02,686 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-29 23:00:03,100 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-29 23:00:03,219 - Yiddish24Scraper - INFO - Received response with 530802 characters

2026-09-29 23:00:03,222 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319621 chars)

2026-09-29 23:00:03,223 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-29 23:00:03,295 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-29 23:00:03,336 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-29 23:00:03,336 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-29 23:00:03,359 - Yiddish24Scraper - INFO - Term 'איבער דאס און יענץ -' matched in DESCRIPTION: 'איבער דאס און יענץ - לאטערי און גורל געווינערס'

2026-09-29 23:00:03,360 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-09-29 23:00:03,930 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/14HBS_260_260929063151.mp3

2026-09-29 23:00:05,937 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_14HBS_260_260929063151.mp3 (44.3 MB)

2026-09-29 23:00:05,938 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-09-29 23:00:05,955 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_14HBS_260_260929063151.mp3: title, artist, album, comment, source_url, genre, publisher

2026-09-29 23:00:05,955 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_14HBS_260_260929063151_איבער_דאס_און_יענץ_-.mp3

2026-09-29 23:00:06,847 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles

2026-09-29 23:00:06,847 - Yiddish24Scraper - INFO - Page 1: 3/100 new items

2026-09-29 23:00:06,847 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination

2026-09-29 23:00:06,848 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3

2026-09-29 23:00:14,651 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-29 23:00:17,618 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-29 23:00:37,116 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.

2026-09-29 23:00:37,117 - IveltScraper - INFO - All forums scrape complete. Found 8 new posts.

2026-09-29 23:00:37,117 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-29 23:00:37,117 - __main__ - INFO - Scraper yiddish24 completed: 3 results

2026-09-29 23:00:37,117 - __main__ - INFO - Scraper ivelt completed: 8 results

2026-09-29 23:00:38,524 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-29 23:00:38.523986

2026-09-29 23:00:38,524 - __main__ - INFO - Email sent successfully

2026-09-29 23:00:38,524 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-29 23:00:38,524 - __main__ - INFO - Monitor complete. Found 11 total results: 3 new yiddish24 results, 8 new ivelt results.

2026-09-29 23:00:38,524 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-29 23:00:38,524 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-29 23:00:38,735 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-29 23:00:38,736 - __main__ - INFO - Closed all database connections

2026-09-29 23:00:38,738 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-29 23:00:38,738 - social_media_monitor.database.connection - INFO - Closed 0 database connections