โ Logs
social_media_monitor_2026-09-23.log
2026-09-23 20:30:01,754 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-23 20:30:01,754 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-23 20:30:01,757 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-23 20:30:01,757 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-23 20:30:01,770 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-23 20:30:01,771 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-23 20:30:01,775 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-23 20:30:01,777 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-23 20:30:01,777 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-23 20:30:01,777 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-23 20:30:01,785 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-23 20:30:01,785 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-23 20:30:01,790 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-23 20:30:01,798 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-23 20:30:01,798 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-23 20:30:01,802 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-23 20:30:01,802 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-23 20:30:01,803 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-23 20:30:01,806 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-23 20:30:01,806 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-23 20:30:01,806 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-23 20:30:01,807 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-23 20:30:02,495 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-23 20:30:02,496 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-23 20:30:02,998 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-23 20:30:03,026 - GitHubScraper - INFO - Found 639 GitHub repositories for term: "Hermes Agent"
2026-09-23 20:30:03,399 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-23 20:30:03,617 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-23 20:30:03,618 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-23 20:30:04,310 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-23 20:30:04,591 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-23 20:30:04,592 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-23 20:30:05,731 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-23 20:30:06,157 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-23 20:30:06,161 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-23 20:30:07,355 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-23 20:30:07,358 - GitHubScraper - INFO - Found 262 GitHub repositories for term: paperclip
2026-09-23 20:30:07,511 - GitHubScraper - INFO - Total GitHub results found: 0
2026-09-23 20:30:09,218 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-23 20:30:09,283 - YouTubeIntelScraper - INFO - YouTube Intel found 26 candidates and 6 new videos
2026-09-23 20:30:09,692 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:09,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:09,745 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 20:30:09,763 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:10,137 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:10,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:10,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:10,253 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:10,569 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:10,588 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:10,612 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:10,713 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:10,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:11,001 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:11,074 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:11,239 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:11,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:11,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:11,603 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:11,662 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 20:30:11,893 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 20:30:11,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:12,034 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:12,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:12,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:12,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:12,618 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:12,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:12,758 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:12,909 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:12,926 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:13,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 20:30:13,259 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:13,268 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:13,285 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 20:30:13,583 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:13,720 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 20:30:13,812 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 20:30:13,815 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:14,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:14,273 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:14,303 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 20:30:14,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:14,688 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:14,958 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,031 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,104 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,388 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,456 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,573 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,593 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,843 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,852 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:15,940 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:16,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:16,331 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:16,342 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:16,375 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:16,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:16,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:16,780 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:16,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,078 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,120 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,275 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,440 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,443 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,467 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,607 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,827 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,861 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:17,950 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:18,008 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:18,119 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:18,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:18,410 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:18,421 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:18,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:18,841 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:18,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:18,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:18,934 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,135 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,348 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,599 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,762 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,775 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,880 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:19,950 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:20,109 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:20,128 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:20,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:20,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 20:30:20,523 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-23 20:30:20,524 - __main__ - INFO - Scraper github completed: 0 results
2026-09-23 20:30:20,524 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-23 20:30:20,525 - __main__ - INFO - Scraper youtube_intel completed: 6 results
2026-09-23 20:30:21,212 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-23 20:30:21.212122
2026-09-23 20:30:21,212 - __main__ - INFO - Email sent successfully
2026-09-23 20:30:21,212 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-23 20:30:21,212 - __main__ - INFO - Monitor complete. Found 6 total results: 6 new youtube intel results.
2026-09-23 20:30:21,212 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-23 20:30:21,212 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-23 20:30:21,254 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-23 20:30:21,254 - __main__ - INFO - Closed all database connections
2026-09-23 20:30:21,257 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-23 20:30:21,257 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-23 21:00:02,281 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-23.log
2026-09-23 21:00:02,282 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-23.log
2026-09-23 21:00:02,282 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-23.log
2026-09-23 21:00:02,282 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-23 21:00:02,311 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-23 21:00:02,311 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-23 21:00:02,314 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-23 21:00:02,314 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-23 21:00:02,331 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-23 21:00:02,331 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-23 21:00:02,337 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-23 21:00:02,339 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-23 21:00:02,339 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-23 21:00:02,345 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-23 21:00:02,345 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-23 21:00:02,345 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-23 21:00:02,350 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-23 21:00:02,358 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-23 21:00:02,358 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-23 21:00:02,360 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-23 21:00:02,360 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-23 21:00:02,360 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-23 21:00:02,362 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-23 21:00:02,362 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-23 21:00:02,363 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-23 21:00:02,363 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-23 21:00:02,455 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-23 21:00:02,461 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-23 21:00:02,461 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-23 21:00:02,462 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-23 21:00:03,187 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-23 21:00:04,668 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-23 21:00:04,852 - Yiddish24Scraper - INFO - Received response with 464972 characters
2026-09-23 21:00:04,854 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (300778 chars)
2026-09-23 21:00:04,856 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-23 21:00:04,945 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-23 21:00:04,990 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-23 21:00:04,990 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-23 21:00:05,018 - Yiddish24Scraper - INFO - Term 'ืืื ืืขืจืขืกืื ืืก -' matched in DESCRIPTION: 'ืืื ืืขืจืขืกืื ืืก - ืืื'ืืืจ ืขืกื ืงืขื ืื'ืก...'
2026-09-23 21:00:05,018 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-09-23 21:00:05,556 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/arye_vayalech__260_260923035606.mp3
2026-09-23 21:00:06,712 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_arye_vayalech__260_260923035606.mp3 (8.4 MB)
2026-09-23 21:00:06,712 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-23 21:00:06,719 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_arye_vayalech__260_260923035606.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-23 21:00:06,720 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_arye_vayalech__260_260923035606_ืืื ืืขืจืขืกืื ืืก_-.mp3
2026-09-23 21:00:07,538 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 100 total articles
2026-09-23 21:00:07,538 - Yiddish24Scraper - INFO - Page 1: 4/100 new items
2026-09-23 21:00:07,538 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination
2026-09-23 21:00:07,538 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4
2026-09-23 21:00:15,981 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-23 21:00:39,256 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-23 21:00:39,256 - IveltScraper - INFO - All forums scrape complete. Found 22 new posts.
2026-09-23 21:00:39,256 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-23 21:00:39,257 - __main__ - INFO - Scraper yiddish24 completed: 4 results
2026-09-23 21:00:39,257 - __main__ - INFO - Scraper ivelt completed: 22 results
2026-09-23 21:00:40,152 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-23 21:00:40.151992
2026-09-23 21:00:40,152 - __main__ - INFO - Email sent successfully
2026-09-23 21:00:40,152 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-23 21:00:40,152 - __main__ - INFO - Monitor complete. Found 26 total results: 4 new yiddish24 results, 22 new ivelt results.
2026-09-23 21:00:40,152 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-23 21:00:40,152 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-23 21:00:40,235 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-23 21:00:40,235 - __main__ - INFO - Closed all database connections
2026-09-23 21:00:40,237 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-23 21:00:40,238 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-23 22:00:01,904 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-23.log
2026-09-23 22:00:01,904 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-23.log
2026-09-23 22:00:01,904 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-23.log
2026-09-23 22:00:01,904 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-23 22:00:01,936 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-23 22:00:01,936 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-23 22:00:01,938 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-23 22:00:01,939 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-23 22:00:01,953 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-23 22:00:01,953 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-23 22:00:02,008 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-23 22:00:02,010 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-23 22:00:02,010 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-23 22:00:02,018 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-23 22:00:02,018 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-23 22:00:02,018 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-23 22:00:02,025 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-23 22:00:02,033 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-23 22:00:02,033 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-23 22:00:02,036 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-23 22:00:02,036 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-23 22:00:02,037 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-23 22:00:02,039 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-23 22:00:02,040 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-23 22:00:02,040 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-23 22:00:02,040 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-23 22:00:02,140 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-23 22:00:02,145 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-23 22:00:02,145 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-23 22:00:02,147 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-23 22:00:02,529 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-23 22:00:04,987 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-23 22:00:05,212 - Yiddish24Scraper - INFO - Received response with 463646 characters
2026-09-23 22:00:05,215 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301960 chars)
2026-09-23 22:00:05,219 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-23 22:00:05,305 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-23 22:00:05,343 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-23 22:00:05,344 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-23 22:00:05,352 - Yiddish24Scraper - INFO - Term 'ืฆืื ืคืื ืื -' matched in DESCRIPTION: 'ืฆืื ืคืื ืื - "ืืืื ืื ืืืขืกื ืฉืจืืืขื, ืืื ืืื ืืืื ืืจืืคืืืืื ืืขื ืืขืืขืคืื"'
2026-09-23 22:00:05,352 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-09-23 22:00:05,921 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/BK__260_260923055526.mp3
2026-09-23 22:00:07,048 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_BK__260_260923055526.mp3 (8.2 MB)
2026-09-23 22:00:07,049 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-23 22:00:07,056 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_BK__260_260923055526.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-23 22:00:07,056 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_BK__260_260923055526_ืฆืื_ืคืื ืื_-.mp3
2026-09-23 22:00:07,801 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles
2026-09-23 22:00:07,801 - Yiddish24Scraper - INFO - Page 1: 3/100 new items
2026-09-23 22:00:07,801 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination
2026-09-23 22:00:07,802 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3
2026-09-23 22:00:15,443 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-23 22:00:29,652 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-23 22:00:29,652 - IveltScraper - INFO - All forums scrape complete. Found 14 new posts.
2026-09-23 22:00:29,652 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-23 22:00:29,653 - __main__ - INFO - Scraper yiddish24 completed: 3 results
2026-09-23 22:00:29,653 - __main__ - INFO - Scraper ivelt completed: 14 results
2026-09-23 22:00:30,548 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-23 22:00:30.548224
2026-09-23 22:00:30,548 - __main__ - INFO - Email sent successfully
2026-09-23 22:00:30,548 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-23 22:00:30,549 - __main__ - INFO - Monitor complete. Found 17 total results: 3 new yiddish24 results, 14 new ivelt results.
2026-09-23 22:00:30,549 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-23 22:00:30,549 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-23 22:00:30,641 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-23 22:00:30,641 - __main__ - INFO - Closed all database connections
2026-09-23 22:00:30,643 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-23 22:00:30,643 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-23 22:30:02,346 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-23.log
2026-09-23 22:30:02,346 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-23.log
2026-09-23 22:30:02,346 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-23.log
2026-09-23 22:30:02,347 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-23 22:30:02,387 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-23 22:30:02,387 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-23 22:30:02,392 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-23 22:30:02,393 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-23 22:30:02,414 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-23 22:30:02,415 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-23 22:30:02,420 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-23 22:30:02,421 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-23 22:30:02,422 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-23 22:30:02,422 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-23 22:30:02,429 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-23 22:30:02,429 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-23 22:30:02,434 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-23 22:30:02,443 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-23 22:30:02,444 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-23 22:30:02,446 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-23 22:30:02,446 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-23 22:30:02,446 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-23 22:30:02,448 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-23 22:30:02,449 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-23 22:30:02,449 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-23 22:30:02,449 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-23 22:30:02,868 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-23 22:30:02,869 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-23 22:30:03,653 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-23 22:30:03,743 - GitHubScraper - INFO - Found 638 GitHub repositories for term: "Hermes Agent"
2026-09-23 22:30:03,892 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:03,893 - GitHubFeedScraper - INFO - GitHub account feed page 1 unchanged (ETag)
2026-09-23 22:30:04,285 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-23 22:30:04,286 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-23 22:30:05,323 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-23 22:30:05,324 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-23 22:30:06,765 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-23 22:30:06,769 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-23 22:30:07,511 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-23 22:30:07,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:07,920 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:07,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:08,062 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:08,121 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-23 22:30:08,124 - GitHubScraper - INFO - Found 262 GitHub repositories for term: paperclip
2026-09-23 22:30:08,338 - GitHubScraper - INFO - Total GitHub results found: 0
2026-09-23 22:30:08,339 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:08,416 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:08,431 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:08,518 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:08,783 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:08,785 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:08,827 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:09,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:09,143 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:09,222 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:09,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:09,601 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 22:30:09,608 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:09,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 22:30:09,873 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 22:30:09,917 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:10,011 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:10,119 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 22:30:10,289 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:10,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 22:30:10,432 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:10,646 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:10,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:10,868 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:10,907 - YouTubeIntelScraper - INFO - YouTube Intel found 26 candidates and 2 new videos
2026-09-23 22:30:10,954 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:11,106 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:11,251 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:11,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 22:30:11,393 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:11,457 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 22:30:11,578 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:11,698 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:11,925 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 22:30:11,969 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:11,975 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:11,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:12,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:12,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:12,484 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:12,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:12,824 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:12,827 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:12,901 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:13,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:13,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:13,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:13,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:13,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:13,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:13,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:13,870 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:13,878 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:14,121 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:14,391 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:14,393 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:14,435 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:14,786 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:14,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:14,816 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:14,960 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:15,116 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:15,158 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:15,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:15,346 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:15,460 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:15,573 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:15,682 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:15,721 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:15,854 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,024 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,101 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,130 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,273 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,486 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,508 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,639 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,745 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:16,978 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,008 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,131 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,353 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,394 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,706 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,795 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,907 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:17,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:18,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:18,144 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:18,211 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:18,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-23 22:30:18,615 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-23 22:30:18,702 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=0 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-23 22:30:18,704 - __main__ - INFO - Scraper github completed: 0 results
2026-09-23 22:30:18,704 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-23 22:30:18,704 - __main__ - INFO - Scraper youtube_intel completed: 2 results
2026-09-23 22:30:19,381 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-23 22:30:19.381568
2026-09-23 22:30:19,381 - __main__ - INFO - Email sent successfully
2026-09-23 22:30:19,382 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-23 22:30:19,382 - __main__ - INFO - Monitor complete. Found 2 total results: 2 new youtube intel results.
2026-09-23 22:30:19,382 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-23 22:30:19,382 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-23 22:30:19,409 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-23 22:30:19,409 - __main__ - INFO - Closed all database connections
2026-09-23 22:30:19,411 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-23 22:30:19,411 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-23 23:00:02,048 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-23.log
2026-09-23 23:00:02,048 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-23.log
2026-09-23 23:00:02,048 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-23.log
2026-09-23 23:00:02,048 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-23 23:00:02,080 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-23 23:00:02,081 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-23 23:00:02,083 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-23 23:00:02,083 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-23 23:00:02,099 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-23 23:00:02,100 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-23 23:00:02,152 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-23 23:00:02,154 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-23 23:00:02,155 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-23 23:00:02,161 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-23 23:00:02,161 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-23 23:00:02,161 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-23 23:00:02,165 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-23 23:00:02,171 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-23 23:00:02,171 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-23 23:00:02,173 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-23 23:00:02,173 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-23 23:00:02,174 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-23 23:00:02,176 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-23 23:00:02,176 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-23 23:00:02,176 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-23 23:00:02,176 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-23 23:00:02,266 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-23 23:00:02,271 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-23 23:00:02,271 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-23 23:00:02,272 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-23 23:00:02,589 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-23 23:00:04,555 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-23 23:00:04,787 - Yiddish24Scraper - INFO - Received response with 468962 characters
2026-09-23 23:00:04,791 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (304166 chars)
2026-09-23 23:00:04,794 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-23 23:00:04,874 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-23 23:00:04,922 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-23 23:00:04,922 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-23 23:00:05,852 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 100 total articles
2026-09-23 23:00:05,852 - Yiddish24Scraper - INFO - Page 1: 10/100 new items
2026-09-23 23:00:05,852 - Yiddish24Scraper - INFO - Low new item ratio (10.0%), stopping pagination
2026-09-23 23:00:05,852 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10
2026-09-23 23:00:14,421 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-23 23:00:32,016 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-09-23 23:00:32,632 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-09-23 23:00:32,632 - IveltScraper - INFO - All forums scrape complete. Found 16 new posts.
2026-09-23 23:00:32,632 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-23 23:00:32,632 - __main__ - INFO - Scraper yiddish24 completed: 10 results
2026-09-23 23:00:32,632 - __main__ - INFO - Scraper ivelt completed: 16 results
2026-09-23 23:00:33,279 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-23 23:00:33.279310
2026-09-23 23:00:33,279 - __main__ - INFO - Email sent successfully
2026-09-23 23:00:33,279 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-23 23:00:33,280 - __main__ - INFO - Monitor complete. Found 26 total results: 10 new yiddish24 results, 16 new ivelt results.
2026-09-23 23:00:33,280 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-23 23:00:33,280 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-23 23:00:33,586 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-23 23:00:33,586 - __main__ - INFO - Closed all database connections
2026-09-23 23:00:33,588 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-23 23:00:33,588 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...