← Logs

social_media_monitor_2026-08-25.log

2026-08-25 18:30:18,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:19,187 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:19,226 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:19,242 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:19,262 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:19,519 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:19,688 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:19,734 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:19,870 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:19,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:20,117 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:20,261 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:20,265 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-25 18:30:20,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:20,538 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:20,618 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:20,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-25 18:30:20,989 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:21,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-25 18:30:21,138 - YouTubeIntelScraper - INFO - YouTube Intel found 41 candidates and 5 new videos

2026-08-25 18:30:21,147 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-25 18:30:21,301 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:21,509 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:21,590 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-25 18:30:21,603 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-25 18:30:21,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:21,990 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:22,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:22,019 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:22,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:22,283 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:22,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:22,478 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-25 18:30:22,531 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:22,735 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:22,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:22,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:22,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:23,325 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-25 18:30:23,394 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:23,442 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-25 18:30:23,554 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:23,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:23,784 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:23,807 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,153 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,183 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,220 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,269 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,534 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,870 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,884 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:24,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:25,189 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:25,243 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:25,333 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:25,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:25,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:25,608 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:25,789 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:25,798 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:25,983 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-25 18:30:26,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:26,130 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:26,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:26,341 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:26,402 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:26,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:26,522 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:26,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:26,803 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:26,874 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:26,889 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:27,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:27,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:27,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-25 18:30:27,403 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=265 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1

2026-08-25 18:30:27,404 - __main__ - INFO - Scraper reddit completed: 2 results

2026-08-25 18:30:27,404 - __main__ - INFO - Scraper github completed: 12 results

2026-08-25 18:30:27,404 - __main__ - INFO - Scraper github_feed completed: 1 results

2026-08-25 18:30:27,405 - __main__ - INFO - Scraper youtube_intel completed: 5 results

2026-08-25 18:30:28,162 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-25 18:30:28.162371

2026-08-25 18:30:28,162 - __main__ - INFO - Email sent successfully

2026-08-25 18:30:28,176 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed

2026-08-25 18:30:28,177 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-25 18:30:28,177 - __main__ - INFO - Monitor complete. Found 20 total results: 2 new reddit results, 12 new github results, 1 new github feed results, 5 new youtube intel results.

2026-08-25 18:30:28,177 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-25 18:30:28,177 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 18:30:28,224 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-25 18:30:28,225 - __main__ - INFO - Closed all database connections

2026-08-25 18:30:28,229 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 18:30:28,229 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-25 18:45:02,104 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-25.log

2026-08-25 18:45:02,105 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-25.log

2026-08-25 18:45:02,105 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-25.log

2026-08-25 18:45:02,105 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-25 18:45:02,131 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-25 18:45:02,131 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-25 18:45:02,134 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-25 18:45:02,134 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-25 18:45:02,147 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-25 18:45:02,148 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-25 18:45:02,150 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')

2026-08-25 18:45:02,151 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-25 18:45:02,153 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-25 18:45:02,153 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-25 18:45:02,156 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-25 18:45:02,161 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-25 18:45:02,161 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-25 18:45:02,163 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-25 18:45:02,163 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-25 18:45:02,163 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-25 18:45:02,165 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-25 18:45:02,165 - __main__ - WARNING - No scrapers enabled or available

2026-08-25 18:45:02,166 - __main__ - INFO - run_id 7 (AhBlick): email sending skipped by configuration.

2026-08-25 18:45:02,166 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-25 18:45:02,166 - __main__ - INFO - Monitor complete. No new results found across all sources.

2026-08-25 18:45:02,166 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-25 18:45:02,166 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 18:45:02,177 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-25 18:45:02,177 - __main__ - INFO - Closed all database connections

2026-08-25 18:45:02,178 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 18:45:02,178 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-25 19:00:02,731 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-25.log

2026-08-25 19:00:02,731 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-25.log

2026-08-25 19:00:02,731 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-25.log

2026-08-25 19:00:02,731 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-25 19:00:02,756 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-25 19:00:02,756 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-25 19:00:02,759 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-25 19:00:02,759 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-25 19:00:02,773 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-25 19:00:02,774 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-25 19:00:02,776 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')

2026-08-25 19:00:02,777 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-25 19:00:02,777 - __main__ - INFO - RSS scraper initialized and enabled

2026-08-25 19:00:02,780 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-25 19:00:02,780 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-25 19:00:02,780 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-08-25 19:00:02,782 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-25 19:00:02,787 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-25 19:00:02,787 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-25 19:00:02,789 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-25 19:00:02,789 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-25 19:00:02,789 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-25 19:00:02,791 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-25 19:00:02,791 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-08-25 19:00:02,791 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-25 19:00:02,792 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-08-25 19:00:02,882 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-08-25 19:00:02,887 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-08-25 19:00:02,887 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-08-25 19:00:02,890 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-08-25 19:00:03,203 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-08-25 19:00:04,958 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-08-25 19:00:05,181 - Yiddish24Scraper - INFO - Received response with 467429 characters

2026-08-25 19:00:05,183 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (302486 chars)

2026-08-25 19:00:05,184 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-08-25 19:00:05,260 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-08-25 19:00:05,302 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements

2026-08-25 19:00:05,302 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1

2026-08-25 19:00:05,954 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 99 total articles

2026-08-25 19:00:05,954 - Yiddish24Scraper - INFO - Page 1: 3/99 new items

2026-08-25 19:00:05,954 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination

2026-08-25 19:00:05,955 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3

2026-08-25 19:00:15,093 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-08-25 19:00:30,730 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-08-25 19:00:31,336 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.

2026-08-25 19:00:31,336 - IveltScraper - INFO - All forums scrape complete. Found 9 new posts.

2026-08-25 19:00:31,337 - __main__ - INFO - Scraper rss completed: 0 results

2026-08-25 19:00:31,337 - __main__ - INFO - Scraper yiddish24 completed: 3 results

2026-08-25 19:00:31,337 - __main__ - INFO - Scraper ivelt completed: 9 results

2026-08-25 19:00:32,480 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-25 19:00:32.480530

2026-08-25 19:00:32,480 - __main__ - INFO - Email sent successfully

2026-08-25 19:00:32,481 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-25 19:00:32,481 - __main__ - INFO - Monitor complete. Found 12 total results: 3 new yiddish24 results, 9 new ivelt results.

2026-08-25 19:00:32,481 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-25 19:00:32,481 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 19:00:32,534 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-25 19:00:32,534 - __main__ - INFO - Closed all database connections

2026-08-25 19:00:32,536 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 19:00:32,536 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-25 20:00:01,986 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-25.log

2026-08-25 20:00:01,986 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-25.log

2026-08-25 20:00:01,986 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-25.log

2026-08-25 20:00:01,986 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-25 20:00:02,011 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-25 20:00:02,011 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-25 20:00:02,013 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-25 20:00:02,014 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-25 20:00:02,028 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-25 20:00:02,028 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-25 20:00:02,077 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')

2026-08-25 20:00:02,078 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-25 20:00:02,078 - __main__ - INFO - RSS scraper initialized and enabled

2026-08-25 20:00:02,081 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-25 20:00:02,081 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-25 20:00:02,081 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-08-25 20:00:02,083 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-25 20:00:02,087 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-25 20:00:02,087 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-25 20:00:02,089 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-25 20:00:02,090 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-25 20:00:02,090 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-25 20:00:02,092 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-25 20:00:02,092 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-08-25 20:00:02,092 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-25 20:00:02,092 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-08-25 20:00:02,181 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-08-25 20:00:02,185 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-08-25 20:00:02,185 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-08-25 20:00:02,186 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-08-25 20:00:02,665 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-08-25 20:00:05,323 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-08-25 20:00:05,538 - Yiddish24Scraper - INFO - Received response with 475883 characters

2026-08-25 20:00:05,541 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (304939 chars)

2026-08-25 20:00:05,544 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-08-25 20:00:05,632 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-08-25 20:00:05,672 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements

2026-08-25 20:00:05,672 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1

2026-08-25 20:00:05,681 - Yiddish24Scraper - INFO - Term 'ענינים שונים' matched in DESCRIPTION: 'ענינים שונים - דארף מען ווארטן פאר'ן כהן?'

2026-08-25 20:00:05,681 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-08-25 20:00:06,181 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/____%27_____%27_________%27_____%27_______________246415874.mp3

2026-08-25 20:00:08,314 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_____'_____'_________'_____'_______________246415874.mp3 (50.0 MB)

2026-08-25 20:00:08,314 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-08-25 20:00:08,347 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_____'_____'_________'_____'_______________246415874.mp3: title, artist, album, comment, source_url, genre, publisher

2026-08-25 20:00:08,347 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_____'_____'_________'_____'_______________246415874_ענינים_שונים.mp3

2026-08-25 20:00:08,992 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 99 total articles

2026-08-25 20:00:08,992 - Yiddish24Scraper - INFO - Page 1: 10/99 new items

2026-08-25 20:00:08,993 - Yiddish24Scraper - INFO - Low new item ratio (10.1%), stopping pagination

2026-08-25 20:00:08,993 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10

2026-08-25 20:00:14,256 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-08-25 20:00:29,839 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.

2026-08-25 20:00:29,839 - IveltScraper - INFO - All forums scrape complete. Found 7 new posts.

2026-08-25 20:00:29,839 - __main__ - INFO - Scraper rss completed: 0 results

2026-08-25 20:00:29,839 - __main__ - INFO - Scraper yiddish24 completed: 10 results

2026-08-25 20:00:29,840 - __main__ - INFO - Scraper ivelt completed: 7 results

2026-08-25 20:00:30,747 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-25 20:00:30.747484

2026-08-25 20:00:30,747 - __main__ - INFO - Email sent successfully

2026-08-25 20:00:30,748 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-25 20:00:30,748 - __main__ - INFO - Monitor complete. Found 17 total results: 10 new yiddish24 results, 7 new ivelt results.

2026-08-25 20:00:30,748 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-25 20:00:30,748 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 20:00:30,899 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-25 20:00:30,899 - __main__ - INFO - Closed all database connections

2026-08-25 20:00:30,902 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 20:00:30,902 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-25 23:33:02,969 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-25.log

2026-08-25 23:33:02,970 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-25.log

2026-08-25 23:33:02,970 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-25.log

2026-08-25 23:33:02,970 - __main__ - INFO - Starting social media monitor

2026-08-25 23:33:02,970 - __main__ - INFO - Using Python: /home/openclaw/Social_Media_Monitor/venv/bin/python

2026-08-25 23:33:03,920 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-25.log

2026-08-25 23:33:03,921 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-25.log

2026-08-25 23:33:03,921 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-25.log

2026-08-25 23:33:03,921 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-25 23:33:03,948 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-25 23:33:03,948 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-25 23:33:03,956 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-25 23:33:03,963 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-25 23:33:03,974 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-25 23:33:03,975 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-25 23:33:04,023 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')

2026-08-25 23:33:04,024 - __main__ - INFO - Reddit scraper initialized and enabled

2026-08-25 23:33:04,030 - __main__ - INFO - GitHub scraper initialized and enabled

2026-08-25 23:33:04,030 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-08-25 23:33:04,035 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-25 23:33:04,035 - __main__ - INFO - RSS scraper initialized and enabled

2026-08-25 23:33:04,041 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-25 23:33:04,041 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-25 23:33:04,041 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-08-25 23:33:04,046 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-25 23:33:04,053 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-25 23:33:04,053 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-25 23:33:04,053 - __main__ - INFO - TorahAnytime scraper initialized and enabled

2026-08-25 23:33:04,055 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-25 23:33:04,055 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-25 23:33:04,055 - __main__ - INFO - Batorah scraper initialized and enabled

2026-08-25 23:33:04,055 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-25 23:33:04,055 - __main__ - INFO - Kol Halashon scraper initialized and enabled

2026-08-25 23:33:04,057 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-25 23:33:04,058 - __main__ - INFO - All Daf scraper initialized and enabled

2026-08-25 23:33:04,058 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-08-25 23:33:04,058 - __main__ - INFO - Yiddish Videos scraper initialized and enabled

2026-08-25 23:33:04,058 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-08-25 23:33:04,058 - __main__ - INFO - Running 12 scrapers concurrently...

2026-08-25 23:33:04,058 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-08-25 23:33:04,058 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['"Hermes Agent"']

2026-08-25 23:33:04,878 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term '"Hermes Agent"'

2026-08-25 23:33:04,900 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hindsight Users: What embedding model and LLM are you using?

2026-08-25 23:33:04,917 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Founder Diary Ep. 1: My Full Business Funnel With Real Conversion Rate

2026-08-25 23:33:04,934 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes agent to engage with customer support bots/humans?

2026-08-25 23:33:04,947 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: My FULL Hermes Agent Setup (HermesOS)

2026-08-25 23:33:04,963 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Desktop App: How do I get rid of the "this device" local gateway that

2026-08-25 23:33:06,164 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 5

2026-08-25 23:33:06,164 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-08-25 23:33:06,164 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['paperclip'] within r/PaperClip_AI+PaperclipAI

2026-08-25 23:33:06,782 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term 'paperclip'

2026-08-25 23:33:08,027 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0

2026-08-25 23:33:08,028 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-08-25 23:33:08,028 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['multica'] within r/hermesagent+HermesAI

2026-08-25 23:33:08,230 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 0 entries for term 'multica'

2026-08-25 23:33:09,230 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0

2026-08-25 23:33:09,231 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']

2026-08-25 23:33:09,429 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-08-25 23:33:09,434 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-08-25 23:33:09,434 - TorahAnytimeScraper - INFO - Starting TorahAnytime scraping (limit 400, max 100 items)

2026-08-25 23:33:09,439 - BatorahScraper - INFO - Starting Batorah scraping (2 APIs, page_size=100, max 100 items)

2026-08-25 23:33:09,444 - BatorahScraper - INFO - Fetching from: https://batorah.com/api/yi/latest-videos-three

2026-08-25 23:33:09,444 - KolHalashonScraper - INFO - Starting Kol Halashon scraping

2026-08-25 23:33:09,499 - KolHalashonScraper - INFO - Found current parsha: Ki Savo (כי תבוא)

2026-08-25 23:33:09,500 - KolHalashonScraper - INFO - Using parsha URL template (id=1): https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?u...

2026-08-25 23:33:09,500 - KolHalashonScraper - INFO - Parsha raw URL template: https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?urlFilters=3:3%7C{speakersfilter}

2026-08-25 23:33:09,502 - KolHalashonScraper - INFO - Speaker IDs for URL id=1: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-08-25 23:33:09,502 - KolHalashonScraper - INFO - Parsha speaker filter string: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-08-25 23:33:09,502 - KolHalashonScraper - INFO - Parsha encoded speaker filter: 2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-08-25 23:33:09,502 - KolHalashonScraper - INFO - Parsha processed URL: https://www2.kolhalashon.com/regularSite/searchResults/1/50/Ki Tavo?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-08-25 23:33:09,502 - KolHalashonScraper - INFO - Current parsha: Ki Savo (כי תבוא)

2026-08-25 23:33:09,502 - KolHalashonScraper - INFO - Processing parsha URL (id=1)

2026-08-25 23:33:09,502 - KolHalashonScraper - INFO - Processing 3 total URLs (1 parsha + 2 search)

2026-08-25 23:33:09,502 - KolHalashonScraper - INFO - Replacing parsha placeholders with id=50, name=Ki Tavo, in_humash=7

2026-08-25 23:33:09,505 - KolHalashonScraper - INFO - Found 1 scheduled daf(s) for 1-day range: [('2026-08-25', 59, 14)]

2026-08-25 23:33:09,505 - KolHalashonScraper - INFO - Generated daf URL for date=2026-08-25, masechet_id=59, name=Nida, daf_no=14

2026-08-25 23:33:09,505 - KolHalashonScraper - INFO - Scraping all 3 URLs with unified method...

2026-08-25 23:33:09,505 - KolHalashonScraper - INFO - Starting multi-URL browser scrape with 3 URLs, max 10 pages per URL (download_inline=True)

2026-08-25 23:33:09,625 - KolHalashonScraper - INFO - Detected installed Chrome major version 151 from '/usr/bin/google-chrome' (output: 'Google Chrome 151.0.7922.108')

2026-08-25 23:33:09,626 - KolHalashonScraper - INFO - Pinning undetected-chromedriver version_main=151 to detected installed Chrome major version

2026-08-25 23:33:09,626 - KolHalashonScraper - INFO - Running browser in headless mode

2026-08-25 23:33:09,626 - KolHalashonScraper - INFO - Browser download directory set to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-08-25 23:33:09,626 - KolHalashonScraper - INFO - Using undetected-chromedriver for Cloudflare bypass (attempt 1/3)

2026-08-25 23:33:11,236 - undetected_chromedriver.patcher - INFO - patching driver executable /home/openclaw/.local/share/undetected_chromedriver/undetected_chromedriver

2026-08-25 23:33:11,847 - KolHalashonScraper - INFO - Browser created for multi-URL scrape

2026-08-25 23:33:11,940 - KolHalashonScraper - INFO - Configured download behavior via Browser.setDownloadBehavior CDP for /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-08-25 23:33:11,946 - KolHalashonScraper - INFO - Configured download behavior via Page.setDownloadBehavior CDP for /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-08-25 23:33:11,946 - KolHalashonScraper - INFO - STEP 1 login: opening base URL https://www2.kolhalashon.com before processing target URLs

2026-08-25 23:33:37,871 - KolHalashonScraper - INFO - Processing URL (id=1): https://www2.kolhalashon.com/regularSite/searchResults/1/50/Ki Tavo?urlFilters=3:3%7C{speakersfilter}

2026-08-25 23:33:37,871 - KolHalashonScraper - INFO - Replaced speakersfilter placeholder with 10 speaker filter(s)

2026-08-25 23:33:37,871 - KolHalashonScraper - INFO - Final processed URL: https://www2.kolhalashon.com/regularSite/searchResults/1/50/Ki Tavo?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-08-25 23:33:37,871 - KolHalashonScraper - INFO - STEP 2 visit processed URL: https://www2.kolhalashon.com/regularSite/searchResults/1/50/Ki Tavo?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-08-25 23:33:38,241 - KolHalashonScraper - INFO - Waiting for JS filtering (0s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:33:38,988 - KolHalashonScraper - INFO - Waiting for JS filtering (0s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:33:43,475 - KolHalashonScraper - INFO - Waiting for JS filtering (5s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:33:48,708 - KolHalashonScraper - INFO - Waiting for JS filtering (10s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:33:49,840 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-25.log

2026-08-25 23:33:49,840 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-25.log

2026-08-25 23:33:49,840 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-25.log

2026-08-25 23:33:49,840 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-25 23:33:49,866 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-25 23:33:49,866 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-25 23:33:49,870 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-25 23:33:49,922 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-25 23:33:49,935 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-25 23:33:49,935 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-25 23:33:49,939 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')

2026-08-25 23:33:49,942 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-25 23:33:49,945 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-25 23:33:49,945 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-25 23:33:49,947 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-25 23:33:49,952 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-25 23:33:49,952 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-25 23:33:49,954 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-25 23:33:49,954 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-25 23:33:49,955 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-25 23:33:49,957 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-25 23:33:49,957 - __main__ - WARNING - No scrapers enabled or available

2026-08-25 23:33:49,957 - __main__ - INFO - run_id 7 (AhBlick): email sending skipped by configuration.

2026-08-25 23:33:49,957 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-25 23:33:49,957 - __main__ - INFO - Monitor complete. No new results found across all sources.

2026-08-25 23:33:49,957 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-25 23:33:49,957 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 23:33:49,958 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-25 23:33:49,958 - __main__ - INFO - Closed all database connections

2026-08-25 23:33:49,958 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 23:33:49,958 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-25 23:33:53,909 - KolHalashonScraper - INFO - Waiting for JS filtering (15s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:33:58,366 - KolHalashonScraper - INFO - Waiting for JS filtering (20s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:33:59,116 - KolHalashonScraper - INFO - Waiting for JS filtering (20s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:03,603 - KolHalashonScraper - INFO - Waiting for JS filtering (25s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:08,817 - KolHalashonScraper - INFO - Waiting for JS filtering (30s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:13,245 - KolHalashonScraper - INFO - Waiting for JS filtering (35s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:13,992 - KolHalashonScraper - INFO - Waiting for JS filtering (35s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:18,484 - KolHalashonScraper - INFO - Waiting for JS filtering (40s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:23,734 - KolHalashonScraper - INFO - Waiting for JS filtering (45s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:28,227 - KolHalashonScraper - INFO - Waiting for JS filtering (50s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:28,962 - KolHalashonScraper - INFO - Waiting for JS filtering (50s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:33,429 - KolHalashonScraper - INFO - Waiting for JS filtering (55s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:34,176 - KolHalashonScraper - INFO - Waiting for JS filtering (55s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:38,662 - KolHalashonScraper - INFO - Waiting for JS filtering (60s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:43,873 - KolHalashonScraper - INFO - Waiting for JS filtering (65s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:48,339 - KolHalashonScraper - INFO - Waiting for JS filtering (70s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:49,081 - KolHalashonScraper - INFO - Waiting for JS filtering (70s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:34:53,508 - KolHalashonScraper - WARNING - JS filtering timeout after 75s (last count: 0)

2026-08-25 23:36:54,857 - KolHalashonScraper - WARNING - No shiur containers found after 120s for URL: https://www2.kolhalashon.com/regularSite/searchResults/1/50/Ki Tavo?urlFilters=3...

2026-08-25 23:36:54,880 - KolHalashonScraper - WARNING - Page title: Kol Halashon, URL: https://www.kolhalashon.com/regularSite/searchResults/1/50/Ki%20Tavo?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C, body length: 2230

2026-08-25 23:36:54,888 - KolHalashonScraper - WARNING - Page content sample:

2026-08-25 23:36:54,888 - KolHalashonScraper - INFO - Processing URL (id=2): https://www2.kolhalashon.com/regularSite/searchResults/6/-1/-1/-1/-1/New%20Shiurei%20Torah?urlFilters=3:3%7C14:50%7C

2026-08-25 23:36:54,888 - KolHalashonScraper - INFO - Final processed URL: https://www2.kolhalashon.com/regularSite/searchResults/6/-1/-1/-1/-1/New%20Shiurei%20Torah?urlFilters=3:3%7C14:50%7C

2026-08-25 23:36:54,889 - KolHalashonScraper - INFO - STEP 2 visit processed URL: https://www2.kolhalashon.com/regularSite/searchResults/6/-1/-1/-1/-1/New%20Shiurei%20Torah?urlFilters=3:3%7C14:50%7C

2026-08-25 23:36:55,042 - KolHalashonScraper - INFO - Waiting for JS filtering (0s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:36:55,789 - KolHalashonScraper - INFO - Waiting for JS filtering (0s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:00,266 - KolHalashonScraper - INFO - Waiting for JS filtering (5s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:05,486 - KolHalashonScraper - INFO - Waiting for JS filtering (10s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:10,710 - KolHalashonScraper - INFO - Waiting for JS filtering (15s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:15,173 - KolHalashonScraper - INFO - Waiting for JS filtering (20s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:15,920 - KolHalashonScraper - INFO - Waiting for JS filtering (20s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:20,389 - KolHalashonScraper - INFO - Waiting for JS filtering (25s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:25,591 - KolHalashonScraper - INFO - Waiting for JS filtering (30s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:30,064 - KolHalashonScraper - INFO - Waiting for JS filtering (35s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:30,814 - KolHalashonScraper - INFO - Waiting for JS filtering (35s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:35,254 - KolHalashonScraper - INFO - Waiting for JS filtering (40s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:40,466 - KolHalashonScraper - INFO - Waiting for JS filtering (45s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:45,662 - KolHalashonScraper - INFO - Waiting for JS filtering (50s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:50,113 - KolHalashonScraper - INFO - Waiting for JS filtering (55s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:50,865 - KolHalashonScraper - INFO - Waiting for JS filtering (55s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:37:55,350 - KolHalashonScraper - INFO - Waiting for JS filtering (60s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:38:00,567 - KolHalashonScraper - INFO - Waiting for JS filtering (65s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:38:05,025 - KolHalashonScraper - INFO - Waiting for JS filtering (70s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:38:05,767 - KolHalashonScraper - INFO - Waiting for JS filtering (70s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:38:10,201 - KolHalashonScraper - WARNING - JS filtering timeout after 75s (last count: 0)

2026-08-25 23:40:11,508 - KolHalashonScraper - WARNING - No shiur containers found after 120s for URL: https://www2.kolhalashon.com/regularSite/searchResults/6/-1/-1/-1/-1/New%20Shiur...

2026-08-25 23:40:11,531 - KolHalashonScraper - WARNING - Page title: Kol Halashon, URL: https://www.kolhalashon.com/regularSite/searchResults/6/-1/-1/-1/-1/New%20Shiurei%20Torah?urlFilters=3:3%7C14:50%7C, body length: 1095

2026-08-25 23:40:11,539 - KolHalashonScraper - WARNING - Page content sample:

2026-08-25 23:40:11,539 - KolHalashonScraper - INFO - Processing URL (id=8): https://www.kolhalashon.com/en/regularSite/searchResults/100/59/Nida?urlFilters=3:3%7C20:14%7C{speakersfilter}

2026-08-25 23:40:11,545 - KolHalashonScraper - INFO - Replaced speakersfilter placeholder with 5 speaker filter(s)

2026-08-25 23:40:11,545 - KolHalashonScraper - INFO - Final processed URL: https://www.kolhalashon.com/en/regularSite/searchResults/100/59/Nida?urlFilters=3:3%7C20:14%7C2:7651%7C2:1608%7C2:7011%7C2:1762%7C2:7163%7C

2026-08-25 23:40:11,545 - KolHalashonScraper - INFO - STEP 2 visit processed URL: https://www.kolhalashon.com/en/regularSite/searchResults/100/59/Nida?urlFilters=3:3%7C20:14%7C2:7651%7C2:1608%7C2:7011%7C2:1762%7C2:7163%7C

2026-08-25 23:40:11,682 - KolHalashonScraper - INFO - Waiting for JS filtering (0s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:12,430 - KolHalashonScraper - INFO - Waiting for JS filtering (0s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:16,907 - KolHalashonScraper - INFO - Waiting for JS filtering (5s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:22,128 - KolHalashonScraper - INFO - Waiting for JS filtering (10s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:27,364 - KolHalashonScraper - INFO - Waiting for JS filtering (15s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:31,832 - KolHalashonScraper - INFO - Waiting for JS filtering (20s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:32,577 - KolHalashonScraper - INFO - Waiting for JS filtering (20s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:37,055 - KolHalashonScraper - INFO - Waiting for JS filtering (25s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:42,274 - KolHalashonScraper - INFO - Waiting for JS filtering (30s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:46,716 - KolHalashonScraper - INFO - Waiting for JS filtering (35s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:47,455 - KolHalashonScraper - INFO - Waiting for JS filtering (35s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:51,922 - KolHalashonScraper - INFO - Waiting for JS filtering (40s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:40:57,113 - KolHalashonScraper - INFO - Waiting for JS filtering (45s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:41:02,315 - KolHalashonScraper - INFO - Waiting for JS filtering (50s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:41:06,775 - KolHalashonScraper - INFO - Waiting for JS filtering (55s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:41:07,520 - KolHalashonScraper - INFO - Waiting for JS filtering (55s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:41:11,995 - KolHalashonScraper - INFO - Waiting for JS filtering (60s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:41:17,217 - KolHalashonScraper - INFO - Waiting for JS filtering (65s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:41:21,701 - KolHalashonScraper - INFO - Waiting for JS filtering (70s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:41:22,449 - KolHalashonScraper - INFO - Waiting for JS filtering (70s): 0 shiurs, 0 filter options, reloading=False

2026-08-25 23:41:26,858 - KolHalashonScraper - WARNING - JS filtering timeout after 75s (last count: 0)

2026-08-25 23:43:28,183 - KolHalashonScraper - WARNING - No shiur containers found after 120s for URL: https://www.kolhalashon.com/en/regularSite/searchResults/100/59/Nida?urlFilters=...

2026-08-25 23:43:28,207 - KolHalashonScraper - WARNING - Page title: Kol Halashon, URL: https://www.kolhalashon.com/en/regularSite/searchResults/100/59/Nida?urlFilters=3:3%7C20:14%7C2:7651%7C2:1608%7C2:7011%7C2:1762%7C2:7163%7C, body length: 1095

2026-08-25 23:43:28,213 - KolHalashonScraper - WARNING - Page content sample:

2026-08-25 23:43:28,214 - KolHalashonScraper - INFO - Multi-URL scrape complete: 0 new shiurim from 0 URLs (0 total pages), 0 total checked

2026-08-25 23:43:28,216 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - Shiurim sync complete: 0 new, 0 already in db, 2508 total

2026-08-25 23:43:28,216 - KolHalashonScraper - INFO - Parsha shiurim: 0 new, 0 match filter, 0 total

2026-08-25 23:43:28,216 - KolHalashonScraper - INFO - Kol Halashon scraping complete: 0 NEW shiurim for email, 0 total new, 0 match filter (all)

2026-08-25 23:43:28,217 - AllDafScraper - INFO - All Daf processing 1 scheduled daf(s)

2026-08-25 23:43:28,217 - AllDafScraper - INFO - All Daf scraping Nidah 14 (https://alldaf.org/todays-daf?cycle=dafyomi&masechta=Nidah&daf=14)

2026-08-25 23:43:28,224 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-08-25 23:43:28,225 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-08-25 23:43:28,232 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-08-25 23:43:28,560 - __main__ - ERROR - Scraper github timed out after 300s; continuing with other results

2026-08-25 23:43:28,562 - __main__ - ERROR - Scraper github_feed timed out after 300s; continuing with other results

2026-08-25 23:43:28,563 - __main__ - ERROR - Scraper yiddish24 timed out after 300s; continuing with other results

2026-08-25 23:43:28,565 - __main__ - ERROR - Scraper torahanytime timed out after 300s; continuing with other results

2026-08-25 23:43:28,566 - __main__ - ERROR - Scraper batorah timed out after 300s; continuing with other results

2026-08-25 23:43:28,568 - __main__ - ERROR - Scraper rss timed out after 300s; continuing with other results

2026-08-25 23:43:28,954 - httpx - INFO - HTTP Request: GET https://alldaf.org/api/trpc/auth.me,popups.fetchByPlatform,posts.fetchList,posts.fetchList,posts.fetchList?batch=1&input=%7B%220%22%3A%7B%22platform%22%3A%22AllDaf%22%7D%2C%221%22%3A%7B%22platform%22%3A%22AllDaf%22%7D%2C%222%22%3A%7B%22limit%22%3A20%2C%22take%22%3A20%2C%22type%22%3A%22Daf+Yomi+Shiurim%22%2C%22allDafSeriesType%22%3A%22Daf+Yomi+Shiurim%22%2C%22metadataValues%22%3A%5B%22Nidah+14%22%5D%2C%22filter%22%3A%7B%7D%2C%22platform%22%3A%22AllDaf%22%7D%2C%223%22%3A%7B%22limit%22%3A20%2C%22take%22%3A20%2C%22type%22%3A%22Supplemental+Clips%22%2C%22allDafSeriesType%22%3A%22Supplemental+Clips%22%2C%22metadataValues%22%3A%5B%22Nidah+14%22%5D%2C%22filter%22%3A%7B%7D%2C%22platform%22%3A%22AllDaf%22%7D%2C%224%22%3A%7B%22limit%22%3A20%2C%22take%22%3A20%2C%22type%22%3A%22Reference+Materials%22%2C%22allDafSeriesType%22%3A%22Reference+Materials%22%2C%22metadataValues%22%3A%5B%22Nidah+14%22%5D%2C%22filter%22%3A%7B%7D%2C%22platform%22%3A%22AllDaf%22%7D%7D "HTTP/1.1 200 OK"

2026-08-25 23:43:28,956 - AllDafScraper - INFO - All Daf fetched 12 record(s) for Nidah 14

2026-08-25 23:43:29,040 - AllDafScraper - INFO - All Daf Nidah 14 complete: 0 new item(s)

2026-08-25 23:43:29,040 - AllDafScraper - INFO - All Daf complete: 0 new item(s), 0 downloaded across 1 daf(s)

2026-08-25 23:43:31,653 - YiddishVideosScraper - INFO - Yiddish Videos scrape complete: 0 new posts

2026-08-25 23:43:38,062 - YouTubeIntelScraper - INFO - YouTube Intel found 41 candidates and 12 new videos

2026-08-25 23:43:40,637 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-08-25 23:43:55,396 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-08-25 23:43:59,464 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-08-25 23:43:59,465 - IveltScraper - INFO - All forums scrape complete. Found 20 new posts.

2026-08-25 23:43:59,465 - __main__ - INFO - Scraper reddit completed: 5 results

2026-08-25 23:43:59,465 - __main__ - INFO - Scraper github completed: 0 results

2026-08-25 23:43:59,465 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-08-25 23:43:59,465 - __main__ - INFO - Scraper rss completed: 0 results

2026-08-25 23:43:59,465 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-08-25 23:43:59,465 - __main__ - INFO - Scraper torahanytime completed: 0 results

2026-08-25 23:43:59,466 - __main__ - INFO - Scraper batorah completed: 0 results

2026-08-25 23:43:59,466 - __main__ - INFO - Scraper kolhalashon completed: 0 results

2026-08-25 23:43:59,466 - __main__ - INFO - Scraper alldaf completed: 0 results

2026-08-25 23:43:59,466 - __main__ - INFO - Scraper ivelt completed: 20 results

2026-08-25 23:43:59,466 - __main__ - INFO - Scraper yiddishvideos completed: 0 results

2026-08-25 23:43:59,466 - __main__ - INFO - Scraper youtube_intel completed: 12 results

2026-08-25 23:44:00,386 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-25 23:44:00.386058

2026-08-25 23:44:00,386 - __main__ - INFO - Email sent successfully

2026-08-25 23:44:00,386 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-25 23:44:00,386 - __main__ - INFO - Monitor complete. Found 37 total results: 5 new reddit results, 20 new ivelt results, 12 new youtube intel results.

2026-08-25 23:44:00,386 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-25 23:44:00,387 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 23:44:00,566 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-25 23:44:00,566 - __main__ - INFO - Closed all database connections

2026-08-25 23:44:00,570 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-25 23:44:00,570 - social_media_monitor.database.connection - INFO - Closed 0 database connections