โ† Logs

social_media_monitor_2026-08-31.log

2026-08-31 20:30:15,998 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:16,054 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:16,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:16,291 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-31 20:30:16,394 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:16,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:16,550 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-31 20:30:16,689 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:16,803 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:16,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:17,007 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:17,099 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:17,255 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:17,363 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:17,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:17,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:17,772 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:17,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:17,921 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-31 20:30:17,985 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:18,074 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:18,360 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:18,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:18,475 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:18,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:18,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:18,837 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:18,884 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:19,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:19,241 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:19,244 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:19,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:19,454 - YouTubeIntelScraper - INFO - YouTube Intel found 43 candidates and 11 new videos
2026-08-31 20:30:19,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:19,631 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:19,639 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:19,833 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:19,954 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:20,018 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:20,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:20,309 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:20,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:20,486 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:20,657 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:20,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:20,924 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:20,976 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:20,993 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:21,157 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:21,325 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:21,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:21,373 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:21,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:21,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:21,776 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:21,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:21,967 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:22,047 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:22,083 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:22,172 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:22,356 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:22,359 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:22,430 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:22,595 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:22,702 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:22,799 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:22,904 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,021 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,067 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,292 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,406 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,556 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,790 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:23,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:24,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:24,144 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:24,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:24,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:24,341 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 20:30:24,379 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=247 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-31 20:30:24,380 - __main__ - INFO - Scraper reddit completed: 1 results
2026-08-31 20:30:24,380 - __main__ - INFO - Scraper github completed: 5 results
2026-08-31 20:30:24,380 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-31 20:30:24,380 - __main__ - INFO - Scraper youtube_intel completed: 11 results
2026-08-31 20:30:27,396 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-31 20:30:27.396080
2026-08-31 20:30:27,396 - __main__ - INFO - Email sent successfully
2026-08-31 20:30:27,396 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-31 20:30:27,396 - __main__ - INFO - Monitor complete. Found 17 total results: 1 new reddit results, 5 new github results, 11 new youtube intel results.
2026-08-31 20:30:27,396 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-31 20:30:27,397 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-31 20:30:27,441 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-31 20:30:27,441 - __main__ - INFO - Closed all database connections
2026-08-31 20:30:27,444 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-31 20:30:27,445 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-31 21:00:02,395 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-31.log
2026-08-31 21:00:02,395 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-31.log
2026-08-31 21:00:02,395 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-31.log
2026-08-31 21:00:02,395 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-31 21:00:02,425 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-31 21:00:02,425 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-31 21:00:02,428 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-31 21:00:02,429 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-31 21:00:02,442 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-31 21:00:02,442 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-31 21:00:02,445 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-31 21:00:02,447 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-31 21:00:02,447 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-31 21:00:02,449 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-31 21:00:02,449 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-31 21:00:02,449 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-31 21:00:02,452 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-31 21:00:02,456 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-31 21:00:02,456 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-31 21:00:02,459 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-31 21:00:02,459 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-31 21:00:02,459 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-31 21:00:02,461 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-31 21:00:02,461 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-31 21:00:02,462 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-31 21:00:02,462 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-31 21:00:02,556 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-31 21:00:02,561 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-08-31 21:00:02,561 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-31 21:00:02,562 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-31 21:00:02,705 - social_media_monitor.database.connection - WARNING - Empty content or source provided to is_duplicate
2026-08-31 21:00:02,705 - social_media_monitor.database.connection - WARNING - Empty item_hash or source provided to store_sent_item
2026-08-31 21:00:02,792 - RSSFeedScraper - INFO - Total RSS/HTML results: 1
2026-08-31 21:00:12,112 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-31 21:00:12,327 - Yiddish24Scraper - INFO - Received response with 476111 characters
2026-08-31 21:00:12,330 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301465 chars)
2026-08-31 21:00:12,334 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-31 21:00:12,421 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-31 21:00:12,469 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-08-31 21:00:12,469 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-08-31 21:00:12,480 - Yiddish24Scraper - INFO - Term 'ืžืขืจืงื•ื•ื™ืจื“ื™ื’ -' matched in DESCRIPTION: 'ืžืขืจืงื•ื•ื™ืจื“ื™ื’ - ืื™ืš ื˜ืจืื›ื˜ ื’ืจืื“'
2026-08-31 21:00:12,480 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-31 21:00:12,985 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_________260_260831042914.mp3
2026-08-31 21:00:14,444 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2__________260_260831042914.mp3 (18.9 MB)
2026-08-31 21:00:14,445 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-31 21:00:14,468 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2__________260_260831042914.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-31 21:00:14,468 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2__________260_260831042914_ืžืขืจืงื•ื•ื™ืจื“ื™ื’_-.mp3
2026-08-31 21:00:14,575 - Yiddish24Scraper - INFO - Term 'ืฉืžืขืœืฆืขืจ' matched in DESCRIPTION: 'ื”ืจื‘ ื•ื•ืขืœื•ื•ืœ ืฉืžืขืœืฆืขืจ'
2026-08-31 21:00:14,575 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: ื“ื™ ื ื™ื™ืŸ ื–ื•ืžืขืจ ื•ื•ืื›ืŸ ื–ืขื ืขืŸ ื’ืขืงื•ืžืขืŸ ืฆื• ื
2026-08-31 21:00:15,076 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_160_1788206504.mp3
2026-08-31 21:00:15,202 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_160_1788206504.mp3 (5.4 MB)
2026-08-31 21:00:15,202 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-31 21:00:15,206 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_160_1788206504.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-31 21:00:15,206 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_160_1788206504_ืฉืžืขืœืฆืขืจ.mp3
2026-08-31 21:00:15,877 - Yiddish24Scraper - INFO - Page 1 summary: 12 new out of 99 total articles
2026-08-31 21:00:15,877 - Yiddish24Scraper - INFO - Page 1: 12/99 new items
2026-08-31 21:00:15,877 - Yiddish24Scraper - INFO - Low new item ratio (12.1%), stopping pagination
2026-08-31 21:00:15,878 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 12
2026-08-31 21:00:15,887 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-31 21:00:15,891 - IveltScraper - INFO - ivelt scrape complete. Checked 0 topics.
2026-08-31 21:00:15,891 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-08-31 21:00:15,891 - __main__ - INFO - Scraper rss completed: 1 results
2026-08-31 21:00:15,891 - __main__ - INFO - Scraper yiddish24 completed: 12 results
2026-08-31 21:00:15,891 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-08-31 21:00:16,992 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-31 21:00:16.992225
2026-08-31 21:00:16,992 - __main__ - INFO - Email sent successfully
2026-08-31 21:00:16,992 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-31 21:00:16,992 - __main__ - INFO - Monitor complete. Found 13 total results: 1 new rss results, 12 new yiddish24 results.
2026-08-31 21:00:16,992 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-31 21:00:16,993 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-31 21:00:17,360 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-31 21:00:17,361 - __main__ - INFO - Closed all database connections
2026-08-31 21:00:17,363 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-31 21:00:17,363 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-31 22:00:01,759 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-31.log
2026-08-31 22:00:01,759 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-31.log
2026-08-31 22:00:01,759 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-31.log
2026-08-31 22:00:01,759 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-31 22:00:01,784 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-31 22:00:01,785 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-31 22:00:01,787 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-31 22:00:01,787 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-31 22:00:01,802 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-31 22:00:01,803 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-31 22:00:01,849 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-31 22:00:01,850 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-31 22:00:01,850 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-31 22:00:01,853 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-31 22:00:01,853 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-31 22:00:01,853 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-31 22:00:01,855 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-31 22:00:01,860 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-31 22:00:01,860 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-31 22:00:01,862 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-31 22:00:01,862 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-31 22:00:01,862 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-31 22:00:01,864 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-31 22:00:01,864 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-31 22:00:01,865 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-31 22:00:01,865 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-31 22:00:01,952 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-31 22:00:01,957 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-08-31 22:00:01,957 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-31 22:00:01,958 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-31 22:00:02,168 - social_media_monitor.database.connection - WARNING - Empty content or source provided to is_duplicate
2026-08-31 22:00:02,168 - social_media_monitor.database.connection - WARNING - Empty item_hash or source provided to store_sent_item
2026-08-31 22:00:02,238 - RSSFeedScraper - INFO - Total RSS/HTML results: 1
2026-08-31 22:00:02,709 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-31 22:00:02,919 - Yiddish24Scraper - INFO - Received response with 465648 characters
2026-08-31 22:00:02,922 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (300626 chars)
2026-08-31 22:00:02,926 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-31 22:00:03,009 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-31 22:00:03,049 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-08-31 22:00:03,049 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-08-31 22:00:03,068 - Yiddish24Scraper - INFO - Term 'ืฉืœื™ื˜' matched in TITLE: 'ื”ืจื‘ ืื”ืจืŸ ื’ืจืืกืžืืŸ ืฉืœื™ื˜"ื'
2026-08-31 22:00:03,068 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ืจื‘ ืื”ืจืŸ ื’ืจืืกืžืืŸ ืฉืœื™ื˜"ื
2026-08-31 22:00:03,587 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__98_________237_1788210669479_767_0_2608_192791831.mp3
2026-08-31 22:00:04,693 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___98_________237_1788210669479_767_0_2608_192791831.mp3 (6.4 MB)
2026-08-31 22:00:04,693 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-31 22:00:04,706 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___98_________237_1788210669479_767_0_2608_192791831.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-31 22:00:04,707 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___98_________237_1788210669479_767_0_2608_192791831_ืฉืœื™ื˜.mp3
2026-08-31 22:00:05,328 - Yiddish24Scraper - INFO - Page 1 summary: 2 new out of 99 total articles
2026-08-31 22:00:05,328 - Yiddish24Scraper - INFO - Page 1: 2/99 new items
2026-08-31 22:00:05,328 - Yiddish24Scraper - INFO - Low new item ratio (2.0%), stopping pagination
2026-08-31 22:00:05,328 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 2
2026-08-31 22:00:15,033 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-31 22:00:32,684 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.
2026-08-31 22:00:32,684 - IveltScraper - INFO - All forums scrape complete. Found 44 new posts.
2026-08-31 22:00:32,685 - __main__ - INFO - Scraper rss completed: 1 results
2026-08-31 22:00:32,685 - __main__ - INFO - Scraper yiddish24 completed: 2 results
2026-08-31 22:00:32,685 - __main__ - INFO - Scraper ivelt completed: 44 results
2026-08-31 22:00:34,039 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-31 22:00:34.039176
2026-08-31 22:00:34,039 - __main__ - INFO - Email sent successfully
2026-08-31 22:00:34,039 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-31 22:00:34,039 - __main__ - INFO - Monitor complete. Found 47 total results: 1 new rss results, 2 new yiddish24 results, 44 new ivelt results.
2026-08-31 22:00:34,040 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-31 22:00:34,040 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-31 22:00:34,113 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-31 22:00:34,114 - __main__ - INFO - Closed all database connections
2026-08-31 22:00:34,116 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-31 22:00:34,116 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-31 22:30:02,125 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-31.log
2026-08-31 22:30:02,125 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-31.log
2026-08-31 22:30:02,125 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-31.log
2026-08-31 22:30:02,125 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-31 22:30:02,154 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-31 22:30:02,154 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-31 22:30:02,157 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-31 22:30:02,158 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-31 22:30:02,174 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-31 22:30:02,174 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-31 22:30:02,176 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-31 22:30:02,176 - __main__ - INFO - Reddit scraper initialized and enabled
2026-08-31 22:30:02,177 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-31 22:30:02,177 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-31 22:30:02,177 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-31 22:30:02,180 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-31 22:30:02,180 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-31 22:30:02,183 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-31 22:30:02,187 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-31 22:30:02,187 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-31 22:30:02,189 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-31 22:30:02,189 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-31 22:30:02,190 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-31 22:30:02,192 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-31 22:30:02,192 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-31 22:30:02,193 - __main__ - INFO - Running 4 scrapers concurrently...
2026-08-31 22:30:02,193 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-31 22:30:02,193 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['"Hermes Agent"']
2026-08-31 22:30:03,110 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term '"Hermes Agent"'
2026-08-31 22:30:03,124 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Long pressing the power button lets me talk to my hermes agent on my p
2026-08-31 22:30:03,135 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Long pressing the power button lets me talk to my hermes agent on my p
2026-08-31 22:30:03,144 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Nous Research ships Hermes Agent Bot Mode for multi-agent group chats
2026-08-31 22:30:03,155 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Setup AI Help Please!!
2026-08-31 22:30:03,168 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: OpenCode Go vs Codex Plus โ€” what are you guys using for Hermes Agent?
2026-08-31 22:30:03,189 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Looking for a mentor or Angel investor for GETLITKCMO
2026-08-31 22:30:04,342 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 6
2026-08-31 22:30:04,342 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-08-31 22:30:04,342 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['paperclip'] within r/PaperClip_AI+PaperclipAI
2026-08-31 22:30:05,023 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term 'paperclip'
2026-08-31 22:30:06,210 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-31 22:30:06,210 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-08-31 22:30:06,210 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['multica'] within r/hermesagent+HermesAI
2026-08-31 22:30:06,448 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 0 entries for term 'multica'
2026-08-31 22:30:07,449 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-31 22:30:07,449 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-08-31 22:30:07,861 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-31 22:30:07,862 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-31 22:30:08,668 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-31 22:30:08,752 - GitHubScraper - INFO - Found 566 GitHub repositories for term: "Hermes Agent"
2026-08-31 22:30:08,906 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-08-31 22:30:09,776 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-31 22:30:09,877 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-31 22:30:09,961 - GitHubScraper - INFO - Found 8318 GitHub repositories for term: "claude code"
2026-08-31 22:30:09,980 - GitHubScraper - INFO - Added new GitHub repository: agentfield
2026-08-31 22:30:10,001 - GitHubScraper - INFO - Added new GitHub repository: opencode-with-claude
2026-08-31 22:30:10,026 - GitHubScraper - INFO - Added new GitHub repository: memlab
2026-08-31 22:30:10,061 - GitHubScraper - INFO - Added new GitHub repository: rust-mcp-sdk
2026-08-31 22:30:10,119 - GitHubScraper - INFO - Added new GitHub repository: EDT-MCP
2026-08-31 22:30:10,126 - GitHubScraper - INFO - Added new GitHub repository: nestjs-doctor
2026-08-31 22:30:10,881 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-08-31 22:30:10,980 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-31 22:30:10,984 - GitHubScraper - INFO - Found 37 GitHub repositories for term: "prime agent"
2026-08-31 22:30:12,025 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-31 22:30:12,028 - GitHubScraper - INFO - Found 255 GitHub repositories for term: paperclip
2026-08-31 22:30:12,209 - GitHubScraper - INFO - Total GitHub results found: 6
2026-08-31 22:30:14,986 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-31 22:30:15,353 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:15,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:15,380 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:15,408 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:15,739 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:15,780 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:15,795 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:15,813 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:16,079 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:16,147 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-31 22:30:16,183 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-31 22:30:16,383 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:16,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:16,543 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:16,633 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:16,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:16,828 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:17,068 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-31 22:30:17,152 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:17,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-31 22:30:17,310 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:17,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:17,471 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:17,625 - YouTubeIntelScraper - INFO - YouTube Intel found 44 candidates and 12 new videos
2026-08-31 22:30:17,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:17,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:17,807 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:17,848 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:18,062 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:18,080 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:18,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:18,345 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:18,458 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:18,466 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:18,745 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:18,790 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:18,972 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:18,975 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:19,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:19,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:19,453 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:19,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:19,609 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:19,752 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:19,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:19,974 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:20,121 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:20,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:20,378 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:20,464 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:20,468 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:20,533 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:20,743 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:20,860 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:20,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:21,002 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:21,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:21,190 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:21,307 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:21,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:21,736 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:21,773 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:21,832 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:21,947 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:22,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:22,196 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:22,249 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:22,365 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:22,525 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:22,562 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:22,643 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:22,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:22,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:22,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,031 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,167 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,256 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,332 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,467 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,720 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,871 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:23,993 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,163 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,270 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,339 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,505 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,523 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,580 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,851 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,862 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:24,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:25,090 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:25,201 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:25,214 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:25,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:25,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-31 22:30:25,413 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=247 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-31 22:30:25,414 - __main__ - INFO - Scraper reddit completed: 6 results
2026-08-31 22:30:25,415 - __main__ - INFO - Scraper github completed: 6 results
2026-08-31 22:30:25,415 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-31 22:30:25,415 - __main__ - INFO - Scraper youtube_intel completed: 12 results
2026-08-31 22:30:26,150 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-31 22:30:26.150133
2026-08-31 22:30:26,150 - __main__ - INFO - Email sent successfully
2026-08-31 22:30:26,150 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-31 22:30:26,150 - __main__ - INFO - Monitor complete. Found 24 total results: 6 new reddit results, 6 new github results, 12 new youtube intel results.
2026-08-31 22:30:26,150 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-31 22:30:26,151 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-31 22:30:26,243 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-31 22:30:26,244 - __main__ - INFO - Closed all database connections
2026-08-31 22:30:26,247 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-31 22:30:26,248 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-31 23:00:02,548 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-31.log
2026-08-31 23:00:02,548 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-31.log
2026-08-31 23:00:02,549 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-31.log
2026-08-31 23:00:02,549 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-31 23:00:02,575 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-31 23:00:02,575 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-31 23:00:02,578 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-31 23:00:02,578 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-31 23:00:02,599 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-31 23:00:02,599 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-31 23:00:02,644 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-31 23:00:02,645 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-31 23:00:02,645 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-31 23:00:02,648 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-31 23:00:02,649 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-31 23:00:02,649 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-31 23:00:02,651 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-31 23:00:02,656 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-31 23:00:02,656 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-31 23:00:02,659 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-31 23:00:02,659 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-31 23:00:02,659 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-31 23:00:02,661 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-31 23:00:02,662 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-31 23:00:02,662 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-31 23:00:02,662 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-31 23:00:02,758 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-31 23:00:02,763 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-08-31 23:00:02,763 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-31 23:00:02,765 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-31 23:00:02,990 - social_media_monitor.database.connection - WARNING - Empty content or source provided to is_duplicate
2026-08-31 23:00:02,990 - social_media_monitor.database.connection - WARNING - Empty item_hash or source provided to store_sent_item
2026-08-31 23:00:03,051 - RSSFeedScraper - INFO - Total RSS/HTML results: 1
2026-08-31 23:00:03,437 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-31 23:00:03,652 - Yiddish24Scraper - INFO - Received response with 470046 characters
2026-08-31 23:00:03,655 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (302519 chars)
2026-08-31 23:00:03,659 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-31 23:00:03,740 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-31 23:00:03,780 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-08-31 23:00:03,780 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-08-31 23:00:03,867 - Yiddish24Scraper - INFO - Term 'ืื™ื‘ืขืจ ื“ืืก ืื•ืŸ ื™ืขื ืฅ -' matched in DESCRIPTION: 'ืื™ื‘ืขืจ ื“ืืก ืื•ืŸ ื™ืขื ืฅ - ื‘ื™ืกื˜ ืžื™ืจ ื ื™ืฉื˜ ื’ืขืงื•ืžืขืŸ ื–ืื’ืŸ ื ื’ื•ื˜ ื™ืืจ, ื‘ื™ืŸ ืื™ืš ื“ื™ืจ ื’ืขืงื•ืžืขืŸ ื–ืื’ืŸ ื ื’ื•ื˜ ื™ืืจ'
2026-08-31 23:00:03,867 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-31 23:00:04,367 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/___________260_260831061136.mp3
2026-08-31 23:00:04,514 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2____________260_260831061136.mp3 (14.2 MB)
2026-08-31 23:00:04,515 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-31 23:00:04,525 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2____________260_260831061136.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-31 23:00:04,525 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2____________260_260831061136_ืื™ื‘ืขืจ_ื“ืืก_ืื•ืŸ_ื™ืขื ืฅ_-.mp3
2026-08-31 23:00:04,534 - Yiddish24Scraper - INFO - Term 'ืขืจืฉื˜ื”ืื ื˜ื™ื’' matched in DESCRIPTION: 'ืขืจืฉื˜ื”ืื ื˜ื™ื’ - ื’ืขื‘ืœื™ื‘ืŸ ืฉื˜ืขืงืŸ ืื•ื ื˜ืขืจื•ื•ืขื’ื ืก'
2026-08-31 23:00:04,534 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-31 23:00:05,368 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM311094D1_260_260831044617.mp3
2026-08-31 23:00:05,549 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM311094D1_260_260831044617.mp3 (7.9 MB)
2026-08-31 23:00:05,549 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-31 23:00:05,554 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM311094D1_260_260831044617.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-31 23:00:05,555 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM311094D1_260_260831044617_ืขืจืฉื˜ื”ืื ื˜ื™ื’.mp3
2026-08-31 23:00:06,212 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 99 total articles
2026-08-31 23:00:06,212 - Yiddish24Scraper - INFO - Page 1: 10/99 new items
2026-08-31 23:00:06,212 - Yiddish24Scraper - INFO - Low new item ratio (10.1%), stopping pagination
2026-08-31 23:00:06,213 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10
2026-08-31 23:02:03,413 - IveltScraper - INFO - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-08-31 23:02:03,413 - IveltScraper - INFO - Retrying in 3s...
2026-08-31 23:04:07,056 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-08-31 23:04:07,057 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-08-31 23:04:07,057 - IveltScraper - WARNING - No cf_clearance cookie set โ€” skipping curl_cffi fallback
2026-08-31 23:04:07,058 - IveltScraper - ERROR - Failed to fetch ivelt active topics page
2026-08-31 23:04:07,058 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-08-31 23:04:07,058 - __main__ - INFO - Scraper rss completed: 1 results
2026-08-31 23:04:07,058 - __main__ - INFO - Scraper yiddish24 completed: 10 results
2026-08-31 23:04:07,058 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-08-31 23:04:07,786 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-31 23:04:07.786688
2026-08-31 23:04:07,786 - __main__ - INFO - Email sent successfully
2026-08-31 23:04:07,787 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-31 23:04:07,787 - __main__ - INFO - Monitor complete. Found 11 total results: 1 new rss results, 10 new yiddish24 results.
2026-08-31 23:04:07,787 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-31 23:04:07,787 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-31 23:04:07,833 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-31 23:04:07,834 - __main__ - INFO - Closed all database connections
2026-08-31 23:04:07,835 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-31 23:04:07,835 - social_media_monitor.database.connection - INFO - Closed 0 database connections