← Logs

social_media_monitor_2026-10-01.log

2026-10-01 20:30:01,810 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-01.log

2026-10-01 20:30:01,811 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-01.log

2026-10-01 20:30:01,811 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-10-01 20:30:01,839 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-10-01 20:30:01,839 - __main__ - INFO - Configuration loaded and validated successfully

2026-10-01 20:30:01,842 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-10-01 20:30:01,842 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-10-01 20:30:01,856 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-10-01 20:30:01,856 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-10-01 20:30:01,859 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-10-01 20:30:01,859 - __main__ - INFO - GitHub scraper initialized and enabled

2026-10-01 20:30:01,859 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-10-01 20:30:01,860 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-10-01 20:30:01,863 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-10-01 20:30:01,863 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-10-01 20:30:01,868 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-10-01 20:30:01,873 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-10-01 20:30:01,873 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-10-01 20:30:01,875 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-10-01 20:30:01,875 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-10-01 20:30:01,875 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-10-01 20:30:01,877 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-10-01 20:30:01,878 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-10-01 20:30:01,878 - __main__ - INFO - Running 3 scrapers concurrently...

2026-10-01 20:30:01,878 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']

2026-10-01 20:30:02,357 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-10-01 20:30:02,358 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-10-01 20:30:03,286 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-10-01 20:30:03,384 - GitHubScraper - INFO - Found 659 GitHub repositories for term: "Hermes Agent"

2026-10-01 20:30:03,578 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-10-01 20:30:03,985 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-10-01 20:30:03,986 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"

2026-10-01 20:30:04,716 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-10-01 20:30:05,002 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-10-01 20:30:05,003 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"

2026-10-01 20:30:05,804 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:05,804 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)

2026-10-01 20:30:06,682 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-10-01 20:30:06,686 - GitHubScraper - INFO - Found 43 GitHub repositories for term: "prime agent"

2026-10-01 20:30:07,796 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-10-01 20:30:07,801 - GitHubScraper - INFO - Found 267 GitHub repositories for term: paperclip

2026-10-01 20:30:07,949 - GitHubScraper - INFO - Total GitHub results found: 0

2026-10-01 20:30:09,091 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-10-01 20:30:09,549 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:09,589 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:09,634 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:09,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:09,955 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:10,003 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:10,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:10,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:10,361 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:10,930 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:10,931 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:10,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:11,268 - YouTubeIntelScraper - INFO - YouTube Intel found 30 candidates and 5 new videos

2026-10-01 20:30:11,325 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:11,339 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:11,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:11,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 20:30:11,688 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:11,700 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:11,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:12,046 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 20:30:12,125 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:12,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:12,144 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:12,378 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:12,746 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:12,798 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:12,833 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:12,893 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:13,128 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:13,222 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:13,441 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:13,513 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:13,574 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:13,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:13,839 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:13,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 20:30:13,982 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:14,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:14,156 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:14,435 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:14,520 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 20:30:14,530 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:14,719 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:14,784 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:14,909 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:14,981 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:15,082 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:15,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:15,433 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:15,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:15,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 20:30:15,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:15,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:16,070 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:16,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:16,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 20:30:16,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:16,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:16,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:16,965 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:17,012 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:17,035 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:17,120 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:17,311 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 20:30:17,374 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:17,438 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:17,495 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:17,736 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:17,799 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:17,869 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:17,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,112 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,173 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,348 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,509 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,515 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,547 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,681 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,848 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,863 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:18,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:19,102 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:19,206 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:19,222 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:19,507 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:19,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:19,708 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:19,869 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:19,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:20,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:20,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:20,283 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:20,388 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:20,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:20,583 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:20,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:20,891 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:20,895 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 20:30:21,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 20:30:21,541 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-10-01 20:30:21,542 - __main__ - INFO - Scraper github completed: 0 results

2026-10-01 20:30:21,542 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-10-01 20:30:21,543 - __main__ - INFO - Scraper youtube_intel completed: 5 results

2026-10-01 20:30:22,753 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-01 20:30:22.753685

2026-10-01 20:30:22,754 - __main__ - INFO - Email sent successfully

2026-10-01 20:30:22,754 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-10-01 20:30:22,754 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new youtube intel results.

2026-10-01 20:30:22,754 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-10-01 20:30:22,754 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-10-01 20:30:22,774 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-10-01 20:30:22,774 - __main__ - INFO - Closed all database connections

2026-10-01 20:30:22,776 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-10-01 20:30:22,777 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-10-01 21:00:02,601 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-01.log

2026-10-01 21:00:02,602 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-01.log

2026-10-01 21:00:02,602 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-01.log

2026-10-01 21:00:02,602 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-10-01 21:00:02,633 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-10-01 21:00:02,633 - __main__ - INFO - Configuration loaded and validated successfully

2026-10-01 21:00:02,635 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-10-01 21:00:02,635 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-10-01 21:00:02,669 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-10-01 21:00:02,669 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-10-01 21:00:02,721 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-10-01 21:00:02,723 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-10-01 21:00:02,723 - __main__ - INFO - RSS scraper initialized and enabled

2026-10-01 21:00:02,729 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-10-01 21:00:02,729 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-10-01 21:00:02,730 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-10-01 21:00:02,734 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-10-01 21:00:02,741 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-10-01 21:00:02,741 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-10-01 21:00:02,743 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-10-01 21:00:02,743 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-10-01 21:00:02,743 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-10-01 21:00:02,746 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-10-01 21:00:02,746 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-10-01 21:00:02,746 - __main__ - INFO - Running 3 scrapers concurrently...

2026-10-01 21:00:02,746 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-10-01 21:00:02,832 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-10-01 21:00:02,836 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters

2026-10-01 21:00:02,836 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-10-01 21:00:02,837 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-10-01 21:00:03,089 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-10-01 21:00:04,655 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-10-01 21:00:05,199 - Yiddish24Scraper - INFO - Received response with 576178 characters

2026-10-01 21:00:05,201 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (328749 chars)

2026-10-01 21:00:05,202 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-10-01 21:00:05,285 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-10-01 21:00:05,325 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-10-01 21:00:05,325 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-10-01 21:00:06,030 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles

2026-10-01 21:00:06,030 - Yiddish24Scraper - INFO - Page 1: 6/100 new items

2026-10-01 21:00:06,030 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination

2026-10-01 21:00:06,030 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-10-01 21:00:15,318 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-10-01 21:00:35,110 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-10-01 21:00:49,581 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-10-01 21:00:49,582 - IveltScraper - INFO - All forums scrape complete. Found 22 new posts.

2026-10-01 21:00:49,582 - __main__ - INFO - Scraper rss completed: 0 results

2026-10-01 21:00:49,582 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-10-01 21:00:49,582 - __main__ - INFO - Scraper ivelt completed: 22 results

2026-10-01 21:00:51,548 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-01 21:00:51.548130

2026-10-01 21:00:51,548 - __main__ - INFO - Email sent successfully

2026-10-01 21:00:51,548 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-10-01 21:00:51,548 - __main__ - INFO - Monitor complete. Found 28 total results: 6 new yiddish24 results, 22 new ivelt results.

2026-10-01 21:00:51,548 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-10-01 21:00:51,548 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-10-01 21:00:51,650 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-10-01 21:00:51,651 - __main__ - INFO - Closed all database connections

2026-10-01 21:00:51,653 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-10-01 21:00:51,653 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-10-01 22:00:02,277 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-01.log

2026-10-01 22:00:02,278 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-01.log

2026-10-01 22:00:02,278 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-01.log

2026-10-01 22:00:02,278 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-10-01 22:00:02,325 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-10-01 22:00:02,325 - __main__ - INFO - Configuration loaded and validated successfully

2026-10-01 22:00:02,328 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-10-01 22:00:02,328 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-10-01 22:00:02,342 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-10-01 22:00:02,343 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-10-01 22:00:02,346 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-10-01 22:00:02,347 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-10-01 22:00:02,347 - __main__ - INFO - RSS scraper initialized and enabled

2026-10-01 22:00:02,351 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-10-01 22:00:02,352 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-10-01 22:00:02,352 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-10-01 22:00:02,356 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-10-01 22:00:02,364 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-10-01 22:00:02,364 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-10-01 22:00:02,368 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-10-01 22:00:02,368 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-10-01 22:00:02,368 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-10-01 22:00:02,372 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-10-01 22:00:02,372 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-10-01 22:00:02,372 - __main__ - INFO - Running 3 scrapers concurrently...

2026-10-01 22:00:02,373 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-10-01 22:00:02,505 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-10-01 22:00:02,510 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters

2026-10-01 22:00:02,510 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-10-01 22:00:02,511 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-10-01 22:00:02,773 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-10-01 22:00:04,134 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-10-01 22:00:04,375 - Yiddish24Scraper - INFO - Received response with 574803 characters

2026-10-01 22:00:04,378 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (327392 chars)

2026-10-01 22:00:04,382 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-10-01 22:00:04,461 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-10-01 22:00:04,503 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-10-01 22:00:04,503 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-10-01 22:00:04,513 - Yiddish24Scraper - INFO - Term 'ענינים שונים' matched in DESCRIPTION: 'ענינים שונים - שלאפן ביי א שיעור חוץ לסוכה'

2026-10-01 22:00:04,513 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-10-01 22:00:05,014 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/31HBS_260_261001053240.mp3

2026-10-01 22:00:05,611 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_31HBS_260_261001053240.mp3 (49.9 MB)

2026-10-01 22:00:05,611 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-10-01 22:00:05,636 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_31HBS_260_261001053240.mp3: title, artist, album, comment, source_url, genre, publisher

2026-10-01 22:00:05,637 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_31HBS_260_261001053240_ענינים_שונים.mp3

2026-10-01 22:00:06,302 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles

2026-10-01 22:00:06,302 - Yiddish24Scraper - INFO - Page 1: 1/100 new items

2026-10-01 22:00:06,302 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination

2026-10-01 22:00:06,303 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1

2026-10-01 22:00:14,964 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-10-01 22:00:22,461 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-10-01 22:00:30,967 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.

2026-10-01 22:00:30,968 - IveltScraper - INFO - All forums scrape complete. Found 6 new posts.

2026-10-01 22:00:30,968 - __main__ - INFO - Scraper rss completed: 0 results

2026-10-01 22:00:30,968 - __main__ - INFO - Scraper yiddish24 completed: 1 results

2026-10-01 22:00:30,968 - __main__ - INFO - Scraper ivelt completed: 6 results

2026-10-01 22:00:31,902 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-01 22:00:31.902843

2026-10-01 22:00:31,903 - __main__ - INFO - Email sent successfully

2026-10-01 22:00:31,903 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-10-01 22:00:31,903 - __main__ - INFO - Monitor complete. Found 7 total results: 1 new yiddish24 results, 6 new ivelt results.

2026-10-01 22:00:31,903 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-10-01 22:00:31,903 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-10-01 22:00:32,150 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-10-01 22:00:32,150 - __main__ - INFO - Closed all database connections

2026-10-01 22:00:32,152 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-10-01 22:00:32,152 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-10-01 22:30:01,932 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-01.log

2026-10-01 22:30:01,932 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-01.log

2026-10-01 22:30:01,932 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-01.log

2026-10-01 22:30:01,932 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-10-01 22:30:01,960 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-10-01 22:30:01,960 - __main__ - INFO - Configuration loaded and validated successfully

2026-10-01 22:30:01,962 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-10-01 22:30:01,963 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-10-01 22:30:01,977 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-10-01 22:30:01,977 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-10-01 22:30:02,024 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-10-01 22:30:02,025 - __main__ - INFO - GitHub scraper initialized and enabled

2026-10-01 22:30:02,025 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-10-01 22:30:02,026 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-10-01 22:30:02,032 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-10-01 22:30:02,032 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-10-01 22:30:02,037 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-10-01 22:30:02,044 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-10-01 22:30:02,044 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-10-01 22:30:02,046 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-10-01 22:30:02,046 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-10-01 22:30:02,046 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-10-01 22:30:02,048 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-10-01 22:30:02,049 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-10-01 22:30:02,049 - __main__ - INFO - Running 3 scrapers concurrently...

2026-10-01 22:30:02,049 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']

2026-10-01 22:30:02,691 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-10-01 22:30:02,692 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-10-01 22:30:03,192 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-10-01 22:30:03,283 - GitHubScraper - INFO - Found 660 GitHub repositories for term: "Hermes Agent"

2026-10-01 22:30:03,849 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-10-01 22:30:03,923 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-10-01 22:30:03,924 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"

2026-10-01 22:30:04,856 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-10-01 22:30:04,936 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-10-01 22:30:04,937 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"

2026-10-01 22:30:05,730 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"

2026-10-01 22:30:06,362 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-10-01 22:30:06,366 - GitHubScraper - INFO - Found 43 GitHub repositories for term: "prime agent"

2026-10-01 22:30:07,331 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-10-01 22:30:07,335 - GitHubScraper - INFO - Found 267 GitHub repositories for term: paperclip

2026-10-01 22:30:07,493 - GitHubScraper - INFO - Total GitHub results found: 0

2026-10-01 22:30:09,601 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-10-01 22:30:09,887 - YouTubeIntelScraper - INFO - YouTube Intel found 30 candidates and 5 new videos

2026-10-01 22:30:10,051 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:10,128 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:10,159 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:10,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:10,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:10,513 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:10,528 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:10,573 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:10,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:10,881 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:10,908 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:11,063 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:11,280 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:11,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:11,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:11,608 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:11,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:11,731 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:11,895 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:12,002 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:12,105 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:12,158 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:12,261 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:12,379 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:12,719 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:12,722 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:12,802 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:12,920 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:13,124 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:13,127 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:13,416 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:13,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:13,438 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:13,483 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:13,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:13,906 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:13,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:13,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:13,991 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:14,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:14,377 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:14,430 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:14,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:14,784 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:14,839 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:14,883 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:15,002 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:15,115 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:15,239 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:15,324 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:15,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:15,512 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:15,637 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:15,725 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:15,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:16,039 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:16,179 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:16,263 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:16,350 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:16,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:16,631 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:16,691 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:16,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:16,950 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:16,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 200 OK"

2026-10-01 22:30:17,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:17,102 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:17,342 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:17,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:17,420 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:17,470 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:17,660 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:17,702 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:17,742 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:17,813 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:18,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:18,101 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:18,137 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:18,395 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:18,430 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:18,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:18,717 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:18,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:18,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,033 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,042 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,210 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,273 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,383 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,425 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,681 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,742 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,756 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,784 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:19,979 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:20,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:20,326 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:20,365 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:20,544 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:21,102 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-10-01 22:30:21,206 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-10-01 22:30:21,207 - __main__ - INFO - Scraper github completed: 0 results

2026-10-01 22:30:21,207 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-10-01 22:30:21,208 - __main__ - INFO - Scraper youtube_intel completed: 5 results

2026-10-01 22:30:22,195 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-01 22:30:22.195145

2026-10-01 22:30:22,195 - __main__ - INFO - Email sent successfully

2026-10-01 22:30:22,195 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-10-01 22:30:22,196 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new youtube intel results.

2026-10-01 22:30:22,196 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-10-01 22:30:22,196 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-10-01 22:30:22,256 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-10-01 22:30:22,256 - __main__ - INFO - Closed all database connections

2026-10-01 22:30:22,259 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-10-01 22:30:22,259 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-10-01 23:00:02,056 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-10-01.log

2026-10-01 23:00:02,056 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-10-01.log

2026-10-01 23:00:02,056 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-10-01.log

2026-10-01 23:00:02,056 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-10-01 23:00:02,085 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-10-01 23:00:02,085 - __main__ - INFO - Configuration loaded and validated successfully

2026-10-01 23:00:02,087 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-10-01 23:00:02,088 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-10-01 23:00:02,102 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-10-01 23:00:02,102 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-10-01 23:00:02,107 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-10-01 23:00:02,109 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-10-01 23:00:02,109 - __main__ - INFO - RSS scraper initialized and enabled

2026-10-01 23:00:02,115 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-10-01 23:00:02,116 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-10-01 23:00:02,116 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-10-01 23:00:02,121 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-10-01 23:00:02,130 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-10-01 23:00:02,130 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-10-01 23:00:02,132 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-10-01 23:00:02,132 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-10-01 23:00:02,133 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-10-01 23:00:02,135 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-10-01 23:00:02,135 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-10-01 23:00:02,135 - __main__ - INFO - Running 3 scrapers concurrently...

2026-10-01 23:00:02,135 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-10-01 23:00:02,225 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-10-01 23:00:02,229 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters

2026-10-01 23:00:02,229 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-10-01 23:00:02,230 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-10-01 23:00:02,506 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-10-01 23:00:04,093 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-10-01 23:00:04,326 - Yiddish24Scraper - INFO - Received response with 590031 characters

2026-10-01 23:00:04,330 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (331391 chars)

2026-10-01 23:00:04,333 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-10-01 23:00:04,411 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-10-01 23:00:04,452 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-10-01 23:00:04,452 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-10-01 23:00:05,291 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles

2026-10-01 23:00:05,292 - Yiddish24Scraper - INFO - Page 1: 5/100 new items

2026-10-01 23:00:05,292 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination

2026-10-01 23:00:05,292 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5

2026-10-01 23:00:14,543 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-10-01 23:00:17,933 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-10-01 23:00:32,179 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.

2026-10-01 23:00:32,179 - IveltScraper - INFO - All forums scrape complete. Found 9 new posts.

2026-10-01 23:00:32,180 - __main__ - INFO - Scraper rss completed: 0 results

2026-10-01 23:00:32,180 - __main__ - INFO - Scraper yiddish24 completed: 5 results

2026-10-01 23:00:32,180 - __main__ - INFO - Scraper ivelt completed: 9 results

2026-10-01 23:00:33,207 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-10-01 23:00:33.207598

2026-10-01 23:00:33,207 - __main__ - INFO - Email sent successfully

2026-10-01 23:00:33,207 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-10-01 23:00:33,208 - __main__ - INFO - Monitor complete. Found 14 total results: 5 new yiddish24 results, 9 new ivelt results.

2026-10-01 23:00:33,208 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-10-01 23:00:33,208 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-10-01 23:00:33,311 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-10-01 23:00:33,312 - __main__ - INFO - Closed all database connections

2026-10-01 23:00:33,315 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-10-01 23:00:33,315 - social_media_monitor.database.connection - INFO - Closed 0 database connections