โ† Logs

social_media_monitor_2026-09-25.log

2026-09-25 20:30:02,276 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-25 20:30:02,279 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-25 20:30:02,280 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-25 20:30:02,280 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-25 20:30:02,280 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-25 20:30:02,283 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-25 20:30:02,284 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-25 20:30:02,287 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-25 20:30:02,294 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-25 20:30:02,294 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-25 20:30:02,297 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-25 20:30:02,297 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-25 20:30:02,297 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-25 20:30:02,301 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-25 20:30:02,301 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-25 20:30:02,301 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-25 20:30:02,301 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-25 20:30:02,743 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-25 20:30:02,744 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-25 20:30:03,412 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-25 20:30:03,445 - GitHubScraper - INFO - Found 641 GitHub repositories for term: "Hermes Agent"
2026-09-25 20:30:03,841 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-25 20:30:03,977 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-25 20:30:03,978 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-25 20:30:04,993 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-25 20:30:04,994 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-25 20:30:05,063 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-25 20:30:06,397 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:06,397 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-25 20:30:06,670 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-25 20:30:06,674 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-25 20:30:07,640 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-25 20:30:07,644 - GitHubScraper - INFO - Found 262 GitHub repositories for term: paperclip
2026-09-25 20:30:07,777 - GitHubScraper - INFO - Total GitHub results found: 0
2026-09-25 20:30:10,450 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-25 20:30:10,795 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 20:30:10,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:10,935 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:10,955 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:11,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:11,233 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 20:30:11,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:11,523 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:11,524 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:11,580 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:11,621 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:11,872 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:11,882 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:11,919 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:11,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:12,138 - YouTubeIntelScraper - INFO - YouTube Intel found 30 candidates and 2 new videos
2026-09-25 20:30:12,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:12,319 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:12,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:12,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 20:30:12,679 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:12,792 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:12,853 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:13,043 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:13,111 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:13,369 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:13,521 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:13,695 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:13,740 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:13,829 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:13,901 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:14,044 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:14,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:14,289 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:14,335 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:14,547 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:14,617 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:14,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 20:30:14,814 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:15,015 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:15,035 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:15,291 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:15,293 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:15,375 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:15,482 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:15,619 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:15,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:15,819 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:15,967 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:16,016 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:16,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:16,293 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:16,324 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:16,363 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:16,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:16,610 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:16,695 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:16,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,197 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,268 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,370 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,519 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,595 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,781 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,810 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:17,999 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:18,183 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:18,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:18,301 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:18,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:18,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:18,547 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:18,693 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 20:30:18,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:18,835 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:18,899 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,069 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,219 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,411 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,421 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,584 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,628 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,742 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,810 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,941 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:19,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:20,126 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:20,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:20,284 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:20,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:20,493 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:20,520 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:20,550 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:20,641 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:21,055 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 20:30:21,064 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 20:30:21,107 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1
2026-09-25 20:30:21,108 - __main__ - INFO - Scraper github completed: 0 results
2026-09-25 20:30:21,108 - __main__ - INFO - Scraper github_feed completed: 1 results
2026-09-25 20:30:21,109 - __main__ - INFO - Scraper youtube_intel completed: 2 results
2026-09-25 20:30:22,109 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-25 20:30:22.109451
2026-09-25 20:30:22,109 - __main__ - INFO - Email sent successfully
2026-09-25 20:30:22,122 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed
2026-09-25 20:30:22,122 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-25 20:30:22,122 - __main__ - INFO - Monitor complete. Found 3 total results: 1 new github feed results, 2 new youtube intel results.
2026-09-25 20:30:22,123 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-25 20:30:22,123 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-25 20:30:22,169 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-25 20:30:22,170 - __main__ - INFO - Closed all database connections
2026-09-25 20:30:22,172 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-25 20:30:22,172 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-25 21:00:01,914 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-25.log
2026-09-25 21:00:01,914 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-25.log
2026-09-25 21:00:01,914 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-25.log
2026-09-25 21:00:01,914 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-25 21:00:01,943 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-25 21:00:01,943 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-25 21:00:01,945 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-25 21:00:01,946 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-25 21:00:01,959 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-25 21:00:01,959 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-25 21:00:01,965 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-25 21:00:01,967 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-25 21:00:01,967 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-25 21:00:01,973 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-25 21:00:01,974 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-25 21:00:01,974 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-25 21:00:01,979 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-25 21:00:01,986 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-25 21:00:01,986 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-25 21:00:01,988 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-25 21:00:01,989 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-25 21:00:01,989 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-25 21:00:01,991 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-25 21:00:01,991 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-25 21:00:01,991 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-25 21:00:01,992 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-25 21:00:02,105 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-25 21:00:02,110 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-25 21:00:02,110 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-25 21:00:02,112 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-25 21:00:02,523 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-25 21:00:03,949 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-25 21:00:04,172 - Yiddish24Scraper - INFO - Received response with 478190 characters
2026-09-25 21:00:04,174 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (298834 chars)
2026-09-25 21:00:04,176 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-25 21:00:04,255 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-25 21:00:04,327 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-25 21:00:04,327 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-25 21:00:04,401 - Yiddish24Scraper - INFO - Term 'ืคื•ืŸ ื“ื™ ืžื’ื™ื“'ืก ื˜ื™ืฉืœ' matched in DESCRIPTION: 'ืคื•ืŸ ื“ื™ ืžื’ื™ื“'ืก ื˜ื™ืฉืœ - ื“ื• ื‘ื™ืกื˜ ืžื™ื˜ ืื™ื ืžื™ื˜ ื–ื™ื™ื ืข ื ืืจื™ืฉืงื™ื™ื˜ืŸ'
2026-09-25 21:00:04,401 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-25 21:00:04,964 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/____________________1MALACH3_260_260925043102.mp3
2026-09-25 21:00:06,794 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_____________________1MALACH3_260_260925043102.mp3 (33.8 MB)
2026-09-25 21:00:06,796 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-25 21:00:06,810 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_____________________1MALACH3_260_260925043102.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-25 21:00:06,810 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_____________________1MALACH3_260_260925043102_ืคื•ืŸ_ื“ื™_ืžื’ื™ื“_ืก_ื˜ื™ืฉืœ.mp3
2026-09-25 21:00:06,900 - Yiddish24Scraper - INFO - Term 'ื ื’ื•ื˜ ื•ื•ืืจื˜' matched in DESCRIPTION: 'ื ื’ื•ื˜ ื•ื•ืืจื˜ - ื•ื•ืขืœื›ืข ืกื•ื›ื” ืื™ื– ืืคืืจ ื˜ืขื’ ื›ืฉืจ ืื•ืŸ ืืคืืจ ืžืืœ ื ื™ืฉื˜?'
2026-09-25 21:00:06,901 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-25 21:00:07,401 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/vh_bruchu_260_260925045332.mp3
2026-09-25 21:00:08,941 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_vh_bruchu_260_260925045332.mp3 (24.2 MB)
2026-09-25 21:00:08,943 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-25 21:00:08,958 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_vh_bruchu_260_260925045332.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-25 21:00:08,977 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_vh_bruchu_260_260925045332_ื_ื’ื•ื˜_ื•ื•ืืจื˜.mp3
2026-09-25 21:00:09,780 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 100 total articles
2026-09-25 21:00:09,780 - Yiddish24Scraper - INFO - Page 1: 11/100 new items
2026-09-25 21:00:09,780 - Yiddish24Scraper - INFO - Low new item ratio (11.0%), stopping pagination
2026-09-25 21:00:09,780 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-09-25 21:00:18,137 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-25 21:00:57,956 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-25 21:00:57,956 - IveltScraper - INFO - All forums scrape complete. Found 3 new posts.
2026-09-25 21:00:57,956 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-25 21:00:57,956 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-09-25 21:00:57,956 - __main__ - INFO - Scraper ivelt completed: 3 results
2026-09-25 21:00:58,989 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-25 21:00:58.989364
2026-09-25 21:00:58,989 - __main__ - INFO - Email sent successfully
2026-09-25 21:00:58,989 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-25 21:00:58,989 - __main__ - INFO - Monitor complete. Found 14 total results: 11 new yiddish24 results, 3 new ivelt results.
2026-09-25 21:00:58,990 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-25 21:00:58,990 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-25 21:00:59,104 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-25 21:00:59,104 - __main__ - INFO - Closed all database connections
2026-09-25 21:00:59,107 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-25 21:00:59,107 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-25 22:00:01,764 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-25.log
2026-09-25 22:00:01,764 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-25.log
2026-09-25 22:00:01,764 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-25.log
2026-09-25 22:00:01,764 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-25 22:00:01,807 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-25 22:00:01,807 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-25 22:00:01,810 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-25 22:00:01,811 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-25 22:00:01,826 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-25 22:00:01,827 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-25 22:00:01,892 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-25 22:00:01,895 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-25 22:00:01,895 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-25 22:00:01,902 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-25 22:00:01,902 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-25 22:00:01,902 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-25 22:00:01,908 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-25 22:00:01,912 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-25 22:00:01,912 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-25 22:00:01,915 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-25 22:00:01,915 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-25 22:00:01,915 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-25 22:00:01,917 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-25 22:00:01,917 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-25 22:00:01,917 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-25 22:00:01,918 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-25 22:00:02,013 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-25 22:00:02,017 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-25 22:00:02,018 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-25 22:00:02,019 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-25 22:00:02,257 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-25 22:00:03,901 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-25 22:00:04,129 - Yiddish24Scraper - INFO - Received response with 486710 characters
2026-09-25 22:00:04,132 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301532 chars)
2026-09-25 22:00:04,136 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-25 22:00:04,212 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-25 22:00:04,253 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-25 22:00:04,253 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-25 22:00:05,006 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles
2026-09-25 22:00:05,007 - Yiddish24Scraper - INFO - Page 1: 1/100 new items
2026-09-25 22:00:05,007 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination
2026-09-25 22:00:05,007 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1
2026-09-25 22:00:18,297 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-25 22:00:39,720 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-25 22:01:00,895 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-09-25 22:01:00,895 - IveltScraper - INFO - All forums scrape complete. Found 7 new posts.
2026-09-25 22:01:00,896 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-25 22:01:00,896 - __main__ - INFO - Scraper yiddish24 completed: 1 results
2026-09-25 22:01:00,896 - __main__ - INFO - Scraper ivelt completed: 7 results
2026-09-25 22:01:01,637 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-25 22:01:01.637283
2026-09-25 22:01:01,637 - __main__ - INFO - Email sent successfully
2026-09-25 22:01:01,637 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-25 22:01:01,637 - __main__ - INFO - Monitor complete. Found 8 total results: 1 new yiddish24 results, 7 new ivelt results.
2026-09-25 22:01:01,637 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-25 22:01:01,638 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-25 22:01:01,716 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-25 22:01:01,717 - __main__ - INFO - Closed all database connections
2026-09-25 22:01:01,718 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-25 22:01:01,719 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-25 22:30:02,465 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-25.log
2026-09-25 22:30:02,465 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-25.log
2026-09-25 22:30:02,465 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-25.log
2026-09-25 22:30:02,465 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-25 22:30:02,494 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-25 22:30:02,495 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-25 22:30:02,497 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-25 22:30:02,497 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-25 22:30:02,517 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-25 22:30:02,517 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-25 22:30:02,522 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-25 22:30:02,524 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-25 22:30:02,524 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-25 22:30:02,525 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-25 22:30:02,530 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-25 22:30:02,530 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-25 22:30:02,536 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-25 22:30:02,543 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-25 22:30:02,543 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-25 22:30:02,545 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-25 22:30:02,545 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-25 22:30:02,545 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-25 22:30:02,547 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-25 22:30:02,548 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-25 22:30:02,548 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-25 22:30:02,548 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-25 22:30:02,962 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-25 22:30:02,963 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-25 22:30:03,620 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-25 22:30:03,645 - GitHubScraper - INFO - Found 642 GitHub repositories for term: "Hermes Agent"
2026-09-25 22:30:03,960 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-25 22:30:04,132 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-25 22:30:04,133 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-25 22:30:04,923 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-25 22:30:05,171 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-25 22:30:05,172 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-25 22:30:06,125 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:06,126 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-25 22:30:06,772 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-25 22:30:06,866 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-25 22:30:08,458 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-25 22:30:08,552 - GitHubScraper - INFO - Found 262 GitHub repositories for term: paperclip
2026-09-25 22:30:08,774 - GitHubScraper - INFO - Total GitHub results found: 0
2026-09-25 22:30:09,069 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-25 22:30:09,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:09,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:09,484 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:09,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:09,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:09,847 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:09,908 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:10,080 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:10,135 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:10,191 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:10,224 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:10,457 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:10,515 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:10,579 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:10,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:10,981 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:11,007 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:11,094 - YouTubeIntelScraper - INFO - YouTube Intel found 30 candidates and 4 new videos
2026-09-25 22:30:11,117 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:11,228 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:11,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:11,371 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:11,554 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:11,654 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:11,728 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:11,741 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:12,064 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:12,079 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:12,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:12,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:12,388 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:12,425 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:12,659 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:12,734 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:12,772 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:12,793 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:13,021 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:13,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:13,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:13,283 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:13,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:13,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:13,668 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:13,678 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:13,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:14,019 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:14,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:14,063 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:14,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:14,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:14,368 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:14,471 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:14,631 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:14,653 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:14,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:14,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:15,011 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:15,153 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:15,280 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:15,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:15,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:15,712 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:15,748 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:15,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:15,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,025 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,103 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,165 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,496 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,587 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:16,802 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,838 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:16,941 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,182 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,257 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,283 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,497 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,561 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,576 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,772 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,921 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:17,986 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,025 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,057 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,266 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,293 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,316 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,343 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,638 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,670 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,675 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:18,988 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:19,159 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-25 22:30:19,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-25 22:30:19,310 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-25 22:30:19,312 - __main__ - INFO - Scraper github completed: 0 results
2026-09-25 22:30:19,312 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-25 22:30:19,312 - __main__ - INFO - Scraper youtube_intel completed: 4 results
2026-09-25 22:30:19,955 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-25 22:30:19.955531
2026-09-25 22:30:19,955 - __main__ - INFO - Email sent successfully
2026-09-25 22:30:19,956 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-25 22:30:19,956 - __main__ - INFO - Monitor complete. Found 4 total results: 4 new youtube intel results.
2026-09-25 22:30:19,956 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-25 22:30:19,956 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-25 22:30:19,991 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-25 22:30:19,991 - __main__ - INFO - Closed all database connections
2026-09-25 22:30:19,994 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-25 22:30:19,994 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-25 23:00:01,814 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-25.log
2026-09-25 23:00:01,815 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-25.log
2026-09-25 23:00:01,815 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-25.log
2026-09-25 23:00:01,815 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-25 23:00:01,847 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-25 23:00:01,847 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-25 23:00:01,850 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-25 23:00:01,851 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-25 23:00:01,867 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-25 23:00:01,867 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-25 23:00:01,874 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-25 23:00:01,877 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-25 23:00:01,877 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-25 23:00:01,885 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-25 23:00:01,885 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-25 23:00:01,885 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-25 23:00:01,889 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-25 23:00:01,894 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-25 23:00:01,894 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-25 23:00:01,896 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-25 23:00:01,896 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-25 23:00:01,896 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-25 23:00:01,899 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-25 23:00:01,899 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-25 23:00:01,899 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-25 23:00:01,899 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-25 23:00:01,998 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-25 23:00:02,005 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-25 23:00:02,005 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-25 23:00:02,006 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-25 23:00:02,344 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-25 23:00:03,686 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-25 23:00:03,919 - Yiddish24Scraper - INFO - Received response with 486710 characters
2026-09-25 23:00:03,922 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301532 chars)
2026-09-25 23:00:03,926 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-25 23:00:04,006 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-25 23:00:04,050 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-25 23:00:04,050 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-25 23:00:05,017 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-25 23:00:05,018 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-25 23:00:05,018 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-25 23:00:05,018 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-25 23:00:15,316 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-25 23:00:27,988 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-25 23:00:37,144 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-25 23:00:37,144 - IveltScraper - INFO - All forums scrape complete. Found 1 new posts.
2026-09-25 23:00:37,145 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-25 23:00:37,145 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-25 23:00:37,145 - __main__ - INFO - Scraper ivelt completed: 1 results
2026-09-25 23:00:37,777 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-25 23:00:37.776999
2026-09-25 23:00:37,777 - __main__ - INFO - Email sent successfully
2026-09-25 23:00:37,777 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-25 23:00:37,778 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new ivelt results.
2026-09-25 23:00:37,778 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-25 23:00:37,778 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-25 23:00:37,878 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-25 23:00:37,879 - __main__ - INFO - Closed all database connections
2026-09-25 23:00:37,880 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-25 23:00:37,880 - social_media_monitor.database.connection - INFO - Closed 0 database connections