← Logs

social_media_monitor_2026-09-06.log

2026-09-06 20:30:02,544 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-06 20:30:02,573 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-06 20:30:02,573 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-06 20:30:02,576 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-06 20:30:02,576 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-06 20:30:02,591 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-06 20:30:02,591 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-06 20:30:02,644 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-06 20:30:02,646 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-06 20:30:02,646 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-06 20:30:02,646 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-06 20:30:02,652 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-06 20:30:02,652 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-06 20:30:02,656 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-06 20:30:02,661 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-06 20:30:02,661 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-06 20:30:02,663 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-06 20:30:02,663 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-06 20:30:02,663 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-06 20:30:02,665 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-06 20:30:02,666 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-06 20:30:02,666 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-06 20:30:02,666 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']

2026-09-06 20:30:03,059 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-06 20:30:03,060 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-06 20:30:03,880 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-06 20:30:03,914 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-06 20:30:03,976 - GitHubScraper - INFO - Found 588 GitHub repositories for term: "Hermes Agent"

2026-09-06 20:30:04,063 - GitHubScraper - INFO - Added new GitHub repository: wsl2-distro-manager

2026-09-06 20:30:04,785 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-06 20:30:05,013 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-06 20:30:05,101 - GitHubScraper - INFO - Found 8503 GitHub repositories for term: "claude code"

2026-09-06 20:30:05,135 - GitHubScraper - INFO - Added new GitHub repository: herdr-mobile-relay

2026-09-06 20:30:05,190 - GitHubScraper - INFO - Added new GitHub repository: ripwire

2026-09-06 20:30:05,199 - GitHubScraper - INFO - Added new GitHub repository: gflow-cli

2026-09-06 20:30:05,219 - GitHubScraper - INFO - Added new GitHub repository: RhinoAI

2026-09-06 20:30:05,230 - GitHubScraper - INFO - Added new GitHub repository: playhtml

2026-09-06 20:30:05,253 - GitHubScraper - INFO - Added new GitHub repository: humanizer

2026-09-06 20:30:05,785 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"

2026-09-06 20:30:06,112 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-06 20:30:06,116 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"

2026-09-06 20:30:07,066 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-06 20:30:07,070 - GitHubScraper - INFO - Found 257 GitHub repositories for term: paperclip

2026-09-06 20:30:07,209 - GitHubScraper - INFO - Total GitHub results found: 7

2026-09-06 20:30:09,418 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-06 20:30:09,827 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:09,831 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:09,860 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:09,869 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:10,154 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:10,199 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:10,256 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:10,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:10,477 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:10,612 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:10,685 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:10,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:10,819 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:10,970 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:11,104 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:11,209 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:11,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:11,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:11,569 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:11,666 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:11,706 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:11,868 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:11,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:12,004 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:12,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:12,243 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:12,434 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:12,465 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:12,534 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:12,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:12,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:12,812 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:12,907 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:13,006 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:13,069 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:13,102 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:13,485 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:13,488 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:13,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 20:30:13,628 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 20:30:13,945 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:13,957 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:13,978 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 20:30:14,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 20:30:14,267 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:14,405 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:14,433 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:14,470 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:14,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:14,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:14,847 - YouTubeIntelScraper - INFO - YouTube Intel found 49 candidates and 11 new videos

2026-09-06 20:30:14,850 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:14,869 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:14,936 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:15,193 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:15,217 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:15,333 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:15,422 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:15,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:15,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:15,760 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:15,908 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:15,948 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,077 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,114 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,209 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,431 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,653 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 20:30:16,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,840 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,874 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:16,949 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,114 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,182 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,202 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,439 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,483 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,555 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,748 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,763 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,845 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:17,852 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,113 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,188 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,246 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,470 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,481 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,576 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,904 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,920 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:18,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:19,137 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:19,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:19,380 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 20:30:19,418 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=242 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-06 20:30:19,419 - __main__ - INFO - Scraper github completed: 7 results

2026-09-06 20:30:19,419 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-06 20:30:19,419 - __main__ - INFO - Scraper youtube_intel completed: 11 results

2026-09-06 20:30:20,143 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-06 20:30:20.143243

2026-09-06 20:30:20,143 - __main__ - INFO - Email sent successfully

2026-09-06 20:30:20,143 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-06 20:30:20,143 - __main__ - INFO - Monitor complete. Found 18 total results: 7 new github results, 11 new youtube intel results.

2026-09-06 20:30:20,143 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-06 20:30:20,144 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-06 20:30:20,264 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-06 20:30:20,264 - __main__ - INFO - Closed all database connections

2026-09-06 20:30:20,266 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-06 20:30:20,266 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-06 21:00:01,896 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-06.log

2026-09-06 21:00:01,896 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-06.log

2026-09-06 21:00:01,896 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-06.log

2026-09-06 21:00:01,896 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-06 21:00:01,926 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-06 21:00:01,927 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-06 21:00:01,929 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-06 21:00:01,930 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-06 21:00:01,946 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-06 21:00:01,946 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-06 21:00:01,949 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-06 21:00:01,950 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-06 21:00:01,950 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-06 21:00:01,952 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-06 21:00:01,952 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-06 21:00:01,952 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-06 21:00:01,955 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-06 21:00:01,959 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-06 21:00:01,959 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-06 21:00:01,962 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-06 21:00:01,962 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-06 21:00:01,962 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-06 21:00:01,968 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-06 21:00:01,968 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-06 21:00:01,968 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-06 21:00:01,969 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-06 21:00:02,064 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-06 21:00:02,070 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-06 21:00:02,070 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-06 21:00:02,072 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-06 21:00:03,493 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-06 21:00:04,874 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-06 21:00:05,088 - Yiddish24Scraper - INFO - Received response with 454204 characters

2026-09-06 21:00:05,089 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (304265 chars)

2026-09-06 21:00:05,091 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-06 21:00:05,190 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-06 21:00:05,232 - Yiddish24Scraper - INFO - Page 1 extraction: 98 successful, 2 failed out of 100 elements

2026-09-06 21:00:05,232 - Yiddish24Scraper - INFO - Parsed 98 articles from HTML on page 1

2026-09-06 21:00:06,070 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 98 total articles

2026-09-06 21:00:06,070 - Yiddish24Scraper - INFO - Page 1: 0/98 new items

2026-09-06 21:00:06,070 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-09-06 21:00:06,071 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-09-06 21:00:14,382 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-06 21:00:49,570 - IveltScraper - INFO - ivelt scrape complete. Checked 7 topics.

2026-09-06 21:00:49,571 - IveltScraper - INFO - All forums scrape complete. Found 26 new posts.

2026-09-06 21:00:49,571 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-06 21:00:49,571 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-09-06 21:00:49,571 - __main__ - INFO - Scraper ivelt completed: 26 results

2026-09-06 21:00:50,324 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-06 21:00:50.324666

2026-09-06 21:00:50,325 - __main__ - INFO - Email sent successfully

2026-09-06 21:00:50,325 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-06 21:00:50,325 - __main__ - INFO - Monitor complete. Found 26 total results: 26 new ivelt results.

2026-09-06 21:00:50,325 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-06 21:00:50,325 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-06 21:00:50,417 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-06 21:00:50,417 - __main__ - INFO - Closed all database connections

2026-09-06 21:00:50,419 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-06 21:00:50,419 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-06 22:00:02,122 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-06.log

2026-09-06 22:00:02,122 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-06.log

2026-09-06 22:00:02,123 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-06.log

2026-09-06 22:00:02,123 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-06 22:00:02,152 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-06 22:00:02,152 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-06 22:00:02,154 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-06 22:00:02,155 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-06 22:00:02,932 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-06 22:00:02,932 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-06 22:00:02,987 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-06 22:00:02,988 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-06 22:00:02,988 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-06 22:00:02,993 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-06 22:00:02,993 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-06 22:00:02,993 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-06 22:00:02,998 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-06 22:00:03,002 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-06 22:00:03,002 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-06 22:00:03,004 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-06 22:00:03,004 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-06 22:00:03,004 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-06 22:00:03,007 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-06 22:00:03,007 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-06 22:00:03,007 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-06 22:00:03,007 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-06 22:00:03,098 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-06 22:00:03,102 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-06 22:00:03,102 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-06 22:00:03,104 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-06 22:00:03,398 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-06 22:00:04,373 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-06 22:00:04,596 - Yiddish24Scraper - INFO - Received response with 452171 characters

2026-09-06 22:00:04,599 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (302682 chars)

2026-09-06 22:00:04,602 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-06 22:00:04,678 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-06 22:00:04,716 - Yiddish24Scraper - INFO - Page 1 extraction: 98 successful, 2 failed out of 100 elements

2026-09-06 22:00:04,717 - Yiddish24Scraper - INFO - Parsed 98 articles from HTML on page 1

2026-09-06 22:00:05,501 - Yiddish24Scraper - INFO - Page 1 summary: 2 new out of 98 total articles

2026-09-06 22:00:05,501 - Yiddish24Scraper - INFO - Page 1: 2/98 new items

2026-09-06 22:00:05,501 - Yiddish24Scraper - INFO - Low new item ratio (2.0%), stopping pagination

2026-09-06 22:00:05,501 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 2

2026-09-06 22:00:15,210 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-06 22:00:28,394 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.

2026-09-06 22:00:28,394 - IveltScraper - INFO - All forums scrape complete. Found 8 new posts.

2026-09-06 22:00:28,395 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-06 22:00:28,395 - __main__ - INFO - Scraper yiddish24 completed: 2 results

2026-09-06 22:00:28,395 - __main__ - INFO - Scraper ivelt completed: 8 results

2026-09-06 22:00:30,139 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-06 22:00:30.139590

2026-09-06 22:00:30,139 - __main__ - INFO - Email sent successfully

2026-09-06 22:00:30,140 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-06 22:00:30,140 - __main__ - INFO - Monitor complete. Found 10 total results: 2 new yiddish24 results, 8 new ivelt results.

2026-09-06 22:00:30,140 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-06 22:00:30,140 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-06 22:00:30,248 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-06 22:00:30,248 - __main__ - INFO - Closed all database connections

2026-09-06 22:00:30,250 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-06 22:00:30,250 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-06 22:30:02,318 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-06.log

2026-09-06 22:30:02,318 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-06.log

2026-09-06 22:30:02,318 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-06.log

2026-09-06 22:30:02,318 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-06 22:30:02,354 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-06 22:30:02,354 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-06 22:30:02,356 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-06 22:30:02,357 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-06 22:30:02,372 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-06 22:30:02,372 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-06 22:30:02,375 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-06 22:30:02,376 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-06 22:30:02,376 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-06 22:30:02,377 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-06 22:30:02,383 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-06 22:30:02,383 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-06 22:30:02,389 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-06 22:30:02,397 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-06 22:30:02,397 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-06 22:30:02,400 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-06 22:30:02,400 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-06 22:30:02,400 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-06 22:30:02,402 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-06 22:30:02,402 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-06 22:30:02,403 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-06 22:30:02,403 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']

2026-09-06 22:30:02,814 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-06 22:30:02,815 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-06 22:30:03,329 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-06 22:30:03,354 - GitHubScraper - INFO - Found 588 GitHub repositories for term: "Hermes Agent"

2026-09-06 22:30:03,686 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-06 22:30:04,330 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-06 22:30:04,335 - GitHubScraper - INFO - Found 8503 GitHub repositories for term: "claude code"

2026-09-06 22:30:04,444 - GitHubScraper - INFO - Added new GitHub repository: revdiff

2026-09-06 22:30:04,454 - GitHubScraper - INFO - Added new GitHub repository: ComfyTV

2026-09-06 22:30:04,470 - GitHubScraper - INFO - Added new GitHub repository: macparakeet

2026-09-06 22:30:04,535 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-06 22:30:05,332 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-06 22:30:05,336 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"

2026-09-06 22:30:05,639 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"

2026-09-06 22:30:06,316 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-06 22:30:06,408 - GitHubScraper - INFO - Found 257 GitHub repositories for term: paperclip

2026-09-06 22:30:06,547 - GitHubScraper - INFO - Total GitHub results found: 3

2026-09-06 22:30:08,675 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-06 22:30:09,062 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:09,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:09,128 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:09,143 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:09,364 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:09,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:09,503 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:09,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:09,713 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 22:30:09,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:09,954 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:10,033 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:10,068 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:10,160 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:10,314 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:10,468 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:10,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:10,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 22:30:10,773 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:10,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:10,896 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:10,945 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:11,160 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:11,176 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:11,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:11,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:11,557 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:11,561 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:11,585 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:11,624 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:11,858 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:11,945 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:12,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:12,136 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:12,219 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:12,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:12,618 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:12,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 22:30:12,678 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 22:30:12,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 22:30:13,014 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:13,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:13,154 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 22:30:13,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 22:30:13,343 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:13,543 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:13,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:13,577 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:13,713 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:13,896 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:13,983 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-06 22:30:14,088 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:14,089 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:14,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:14,457 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:14,475 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:14,479 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:14,528 - YouTubeIntelScraper - INFO - YouTube Intel found 50 candidates and 14 new videos

2026-09-06 22:30:14,864 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:14,894 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:14,912 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:14,976 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,264 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,271 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,289 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,638 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,682 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,867 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,901 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:15,974 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:16,060 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:16,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:16,263 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:16,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:16,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:16,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:16,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:16,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:16,751 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,012 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,098 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,433 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,497 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,543 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,718 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:17,836 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:18,049 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:18,094 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:18,175 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:18,185 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:18,375 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:18,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:18,619 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-06 22:30:18,671 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=242 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-06 22:30:18,672 - __main__ - INFO - Scraper github completed: 3 results

2026-09-06 22:30:18,672 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-06 22:30:18,672 - __main__ - INFO - Scraper youtube_intel completed: 14 results

2026-09-06 22:30:19,265 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-06 22:30:19.265188

2026-09-06 22:30:19,265 - __main__ - INFO - Email sent successfully

2026-09-06 22:30:19,265 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-06 22:30:19,265 - __main__ - INFO - Monitor complete. Found 17 total results: 3 new github results, 14 new youtube intel results.

2026-09-06 22:30:19,266 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-06 22:30:19,266 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-06 22:30:19,297 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-06 22:30:19,297 - __main__ - INFO - Closed all database connections

2026-09-06 22:30:19,299 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-06 22:30:19,299 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-06 23:00:02,628 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-06.log

2026-09-06 23:00:02,628 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-06.log

2026-09-06 23:00:02,628 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-06.log

2026-09-06 23:00:02,628 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-06 23:00:02,667 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-06 23:00:02,667 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-06 23:00:02,670 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-06 23:00:02,671 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-06 23:00:02,690 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-06 23:00:02,690 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-06 23:00:02,693 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-06 23:00:02,694 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-06 23:00:02,694 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-06 23:00:02,698 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-06 23:00:02,698 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-06 23:00:02,698 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-06 23:00:02,703 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-06 23:00:02,709 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-06 23:00:02,709 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-06 23:00:02,711 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-06 23:00:02,712 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-06 23:00:02,712 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-06 23:00:02,715 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-06 23:00:02,715 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-06 23:00:02,716 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-06 23:00:02,716 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-06 23:00:02,849 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-06 23:00:02,856 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-06 23:00:02,856 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-06 23:00:02,860 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-06 23:00:03,151 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-06 23:00:04,797 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-06 23:00:05,008 - Yiddish24Scraper - INFO - Received response with 464704 characters

2026-09-06 23:00:05,011 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (305159 chars)

2026-09-06 23:00:05,014 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-06 23:00:05,095 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-06 23:00:05,135 - Yiddish24Scraper - INFO - Page 1 extraction: 98 successful, 2 failed out of 100 elements

2026-09-06 23:00:05,135 - Yiddish24Scraper - INFO - Parsed 98 articles from HTML on page 1

2026-09-06 23:00:05,147 - Yiddish24Scraper - INFO - Term 'צום פינטל -' matched in DESCRIPTION: 'צום פינטל - 15 מיליאן אין באנק'

2026-09-06 23:00:05,147 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-09-06 23:00:05,648 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/TZIM_PINTEL_9875_260_260906063937.mp3

2026-09-06 23:00:06,653 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_TZIM_PINTEL_9875_260_260906063937.mp3 (4.4 MB)

2026-09-06 23:00:06,654 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-09-06 23:00:06,664 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_TZIM_PINTEL_9875_260_260906063937.mp3: title, artist, album, comment, source_url, genre, publisher

2026-09-06 23:00:06,665 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_TZIM_PINTEL_9875_260_260906063937_צום_פינטל_-.mp3

2026-09-06 23:00:07,466 - Yiddish24Scraper - INFO - Page 1 summary: 9 new out of 98 total articles

2026-09-06 23:00:07,466 - Yiddish24Scraper - INFO - Page 1: 9/98 new items

2026-09-06 23:00:07,467 - Yiddish24Scraper - INFO - Low new item ratio (9.2%), stopping pagination

2026-09-06 23:00:07,467 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 9

2026-09-06 23:00:15,075 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-06 23:00:33,770 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-09-06 23:00:33,770 - IveltScraper - INFO - All forums scrape complete. Found 10 new posts.

2026-09-06 23:00:33,770 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-06 23:00:33,771 - __main__ - INFO - Scraper yiddish24 completed: 9 results

2026-09-06 23:00:33,771 - __main__ - INFO - Scraper ivelt completed: 10 results

2026-09-06 23:00:34,542 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-06 23:00:34.542483

2026-09-06 23:00:34,542 - __main__ - INFO - Email sent successfully

2026-09-06 23:00:34,543 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-06 23:00:34,543 - __main__ - INFO - Monitor complete. Found 19 total results: 9 new yiddish24 results, 10 new ivelt results.

2026-09-06 23:00:34,543 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-06 23:00:34,543 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-06 23:00:34,661 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-06 23:00:34,661 - __main__ - INFO - Closed all database connections

2026-09-06 23:00:34,663 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-06 23:00:34,663 - social_media_monitor.database.connection - INFO - Closed 0 database connections