โ† Logs

social_media_monitor_2026-08-07.log

2026-08-07 20:30:01,900 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-07 20:30:01,902 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-07 20:30:01,903 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-07 20:30:01,914 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-07 20:30:01,914 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-07 20:30:01,917 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-07 20:30:01,917 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-07 20:30:01,917 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-07 20:30:01,917 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-07 20:30:01,920 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-07 20:30:01,920 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-07 20:30:01,922 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-07 20:30:01,927 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-07 20:30:01,927 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-07 20:30:01,929 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-07 20:30:01,929 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-07 20:30:01,929 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-07 20:30:01,931 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-07 20:30:01,931 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-07 20:30:01,931 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-07 20:30:01,932 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-07 20:30:02,351 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-07 20:30:02,352 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-07 20:30:03,055 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-07 20:30:03,149 - GitHubScraper - INFO - Found 247 GitHub repositories for term: paperclip
2026-08-07 20:30:03,538 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:03,538 - GitHubFeedScraper - INFO - GitHub account feed page 1 unchanged (ETag)
2026-08-07 20:30:04,131 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-07 20:30:04,136 - GitHubScraper - INFO - Found 504 GitHub repositories for term: "Hermes Agent"
2026-08-07 20:30:05,106 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-07 20:30:05,135 - GitHubScraper - INFO - Found 59 GitHub repositories for term: multica
2026-08-07 20:30:05,268 - GitHubScraper - INFO - Total GitHub results found: 0
2026-08-07 20:30:07,186 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-07 20:30:07,638 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:07,658 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:07,677 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:07,701 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:08,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:08,119 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:08,160 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:08,178 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:08,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:08,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:08,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:08,954 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:08,981 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:08,983 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:09,067 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:09,255 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:09,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:09,482 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:09,533 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:09,538 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:09,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:09,893 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:09,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:09,936 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:10,185 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:10,255 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:10,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:10,435 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:10,653 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:10,767 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:10,781 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:11,051 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:11,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:11,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:11,413 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:11,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:11,475 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:11,695 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:11,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:11,979 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:11,982 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:11,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:12,277 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:12,322 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:12,501 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:12,544 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:12,590 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:12,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:12,898 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:12,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:13,025 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:13,043 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:13,242 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:13,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:13,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:13,442 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:13,621 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:13,644 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:13,678 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:13,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:14,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:14,149 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:14,238 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:14,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:14,508 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:14,568 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:14,630 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:14,804 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:14,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:14,870 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,012 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,119 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,332 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,564 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,669 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,798 - YouTubeIntelScraper - INFO - YouTube Intel found 55 candidates and 9 new videos
2026-08-07 20:30:15,891 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:15,935 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:16,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:16,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:16,230 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:16,389 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 20:30:16,392 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:16,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:16,603 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:16,743 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:16,751 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:16,814 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:16,871 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:17,072 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:17,111 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:17,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:17,257 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:17,402 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:17,521 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:17,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:17,587 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 20:30:17,676 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=0 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-07 20:30:17,677 - __main__ - INFO - Scraper github completed: 0 results
2026-08-07 20:30:17,678 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-07 20:30:17,678 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-08-07 20:30:19,214 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-07 20:30:19.214029
2026-08-07 20:30:19,214 - __main__ - INFO - Email sent successfully
2026-08-07 20:30:19,214 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-07 20:30:19,214 - __main__ - INFO - Monitor complete. Found 9 total results: 9 new youtube intel results.
2026-08-07 20:30:19,214 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-07 20:30:19,214 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-07 20:30:19,253 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-07 20:30:19,253 - __main__ - INFO - Closed all database connections
2026-08-07 20:30:19,256 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-07 20:30:19,256 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-07 21:00:02,239 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-07.log
2026-08-07 21:00:02,239 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-07.log
2026-08-07 21:00:02,239 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-07.log
2026-08-07 21:00:02,239 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-07 21:00:02,270 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-07 21:00:02,270 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-07 21:00:02,272 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-07 21:00:02,273 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-07 21:00:02,287 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-07 21:00:02,287 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-07 21:00:02,333 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-07 21:00:02,334 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-07 21:00:02,334 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-07 21:00:02,337 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-07 21:00:02,337 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-07 21:00:02,337 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-07 21:00:02,340 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-07 21:00:02,344 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-07 21:00:02,344 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-07 21:00:02,346 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-07 21:00:02,346 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-07 21:00:02,346 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-07 21:00:02,349 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-07 21:00:02,349 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-07 21:00:02,349 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-07 21:00:02,349 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-07 21:00:02,438 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-07 21:00:02,443 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-07 21:00:02,443 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-07 21:00:02,445 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-07 21:00:02,529 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-07 21:00:02,531 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-07 21:00:06,226 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-07 21:00:06,444 - Yiddish24Scraper - INFO - Received response with 431615 characters
2026-08-07 21:00:06,446 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (291401 chars)
2026-08-07 21:00:06,447 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-07 21:00:06,515 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-07 21:00:06,561 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-07 21:00:06,561 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-07 21:00:06,664 - Yiddish24Scraper - INFO - Term 'ืžืขืฉื”' matched in DESCRIPTION: 'ื•ื•ืขืจ ืฉื˜ื™ื™ื˜ ืื•ื ื˜ืขืจ ื“ื™ ืžืขืฉื” ืคื•ืŸ ื“ื™ ื ื™ื’ื•ืŸ'
2026-08-07 21:00:06,664 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-07 21:00:07,164 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM31748D_260_260807035417.mp3
2026-08-07 21:00:08,399 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM31748D_260_260807035417.mp3 (11.6 MB)
2026-08-07 21:00:08,399 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-07 21:00:08,417 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM31748D_260_260807035417.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-07 21:00:08,418 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM31748D_260_260807035417_ืžืขืฉื”.mp3
2026-08-07 21:00:08,429 - Yiddish24Scraper - INFO - Term 'ืฉืœื™ื˜' matched in TITLE: 'ื”ืจื‘ ืฉืœืžื” ื”ืืคืžืืŸ ืฉืœื™ื˜"ื'
2026-08-07 21:00:08,429 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ืจื‘ ืฉืœืžื” ื”ืืคืžืืŸ ืฉืœื™ื˜"ื
2026-08-07 21:00:08,929 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/Reeh_A_Herliche_Briv_YOUTUBE_1080p_173_17_912584196.mp3
2026-08-07 21:00:10,219 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_Reeh_A_Herliche_Briv_YOUTUBE_1080p_173_17_912584196.mp3 (11.0 MB)
2026-08-07 21:00:10,220 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-07 21:00:10,231 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_Reeh_A_Herliche_Briv_YOUTUBE_1080p_173_17_912584196.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-07 21:00:10,231 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_Reeh_A_Herliche_Briv_YOUTUBE_1080p_173_17_912584196_ืฉืœื™ื˜.mp3
2026-08-07 21:00:10,317 - Yiddish24Scraper - INFO - Term 'ืื™ื ืกืคื™ืจืืฆื™ืข -' matched in DESCRIPTION: 'ืื™ื ืกืคื™ืจืืฆื™ืข - ื›ืืค ืืจื™ื™ืŸ, ื ื™ืฅ ืขืก ืื•ื™ืก'
2026-08-07 21:00:10,317 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-07 21:00:10,817 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_____________260_260807030448.mp3
2026-08-07 21:00:12,155 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2______________260_260807030448.mp3 (14.3 MB)
2026-08-07 21:00:12,155 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-07 21:00:12,163 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2______________260_260807030448.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-07 21:00:12,164 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2______________260_260807030448_ืื™ื ืกืคื™ืจืืฆื™ืข_-.mp3
2026-08-07 21:00:12,747 - Yiddish24Scraper - INFO - Page 1 summary: 18 new out of 100 total articles
2026-08-07 21:00:12,747 - Yiddish24Scraper - INFO - Page 1: 18/100 new items
2026-08-07 21:00:12,747 - Yiddish24Scraper - INFO - Low new item ratio (18.0%), stopping pagination
2026-08-07 21:00:12,747 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 18
2026-08-07 21:00:14,262 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-07 21:00:24,219 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-08-07 21:00:40,372 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-08-07 21:00:40,372 - IveltScraper - INFO - All forums scrape complete. Found 14 new posts.
2026-08-07 21:00:40,372 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-07 21:00:40,372 - __main__ - INFO - Scraper yiddish24 completed: 18 results
2026-08-07 21:00:40,372 - __main__ - INFO - Scraper ivelt completed: 14 results
2026-08-07 21:00:41,655 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-07 21:00:41.655214
2026-08-07 21:00:41,655 - __main__ - INFO - Email sent successfully
2026-08-07 21:00:41,655 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-07 21:00:41,656 - __main__ - INFO - Monitor complete. Found 32 total results: 18 new yiddish24 results, 14 new ivelt results.
2026-08-07 21:00:41,656 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-07 21:00:41,656 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-07 21:00:41,749 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-07 21:00:41,750 - __main__ - INFO - Closed all database connections
2026-08-07 21:00:41,751 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-07 21:00:41,752 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-07 22:00:01,768 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-07.log
2026-08-07 22:00:01,769 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-07.log
2026-08-07 22:00:01,769 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-07.log
2026-08-07 22:00:01,769 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-07 22:00:01,800 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-07 22:00:01,800 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-07 22:00:01,802 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-07 22:00:01,803 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-07 22:00:01,816 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-07 22:00:01,816 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-07 22:00:01,819 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-07 22:00:01,820 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-07 22:00:01,820 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-07 22:00:01,822 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-07 22:00:01,822 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-07 22:00:01,822 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-07 22:00:01,825 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-07 22:00:01,829 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-07 22:00:01,829 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-07 22:00:01,831 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-07 22:00:01,832 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-07 22:00:01,832 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-07 22:00:01,834 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-07 22:00:01,834 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-07 22:00:01,834 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-07 22:00:01,834 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-07 22:00:01,928 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-07 22:00:01,933 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-07 22:00:01,933 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-07 22:00:01,935 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-07 22:00:02,069 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-07 22:00:02,071 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-07 22:00:05,741 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-07 22:00:05,962 - Yiddish24Scraper - INFO - Received response with 440211 characters
2026-08-07 22:00:05,965 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (293899 chars)
2026-08-07 22:00:05,969 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-07 22:00:06,067 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-07 22:00:06,112 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-07 22:00:06,112 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-07 22:00:06,885 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 100 total articles
2026-08-07 22:00:06,885 - Yiddish24Scraper - INFO - Page 1: 4/100 new items
2026-08-07 22:00:06,885 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination
2026-08-07 22:00:06,886 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4
2026-08-07 22:00:13,918 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-07 22:00:35,719 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-08-07 22:00:35,719 - IveltScraper - INFO - All forums scrape complete. Found 9 new posts.
2026-08-07 22:00:35,720 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-07 22:00:35,720 - __main__ - INFO - Scraper yiddish24 completed: 4 results
2026-08-07 22:00:35,720 - __main__ - INFO - Scraper ivelt completed: 9 results
2026-08-07 22:00:36,622 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-07 22:00:36.622782
2026-08-07 22:00:36,623 - __main__ - INFO - Email sent successfully
2026-08-07 22:00:36,623 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-07 22:00:36,623 - __main__ - INFO - Monitor complete. Found 13 total results: 4 new yiddish24 results, 9 new ivelt results.
2026-08-07 22:00:36,623 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-07 22:00:36,623 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-07 22:00:36,735 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-07 22:00:36,735 - __main__ - INFO - Closed all database connections
2026-08-07 22:00:36,737 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-07 22:00:36,737 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-07 22:30:01,666 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-07.log
2026-08-07 22:30:01,666 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-07.log
2026-08-07 22:30:01,666 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-07.log
2026-08-07 22:30:01,666 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-07 22:30:01,700 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-07 22:30:01,700 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-07 22:30:01,702 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-07 22:30:01,703 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-07 22:30:01,715 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-07 22:30:01,715 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-07 22:30:01,758 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-07 22:30:01,758 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-07 22:30:01,758 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-07 22:30:01,759 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-07 22:30:01,762 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-07 22:30:01,762 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-07 22:30:01,765 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-07 22:30:01,769 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-07 22:30:01,769 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-07 22:30:01,772 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-07 22:30:01,772 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-07 22:30:01,772 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-07 22:30:01,775 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-07 22:30:01,775 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-07 22:30:01,775 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-07 22:30:01,775 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-07 22:30:02,196 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-07 22:30:02,197 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-07 22:30:02,843 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-07 22:30:02,868 - GitHubScraper - INFO - Found 247 GitHub repositories for term: paperclip
2026-08-07 22:30:03,247 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:03,248 - GitHubFeedScraper - INFO - GitHub account feed page 1 unchanged (ETag)
2026-08-07 22:30:03,952 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-07 22:30:04,044 - GitHubScraper - INFO - Found 504 GitHub repositories for term: "Hermes Agent"
2026-08-07 22:30:05,050 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-07 22:30:05,055 - GitHubScraper - INFO - Found 59 GitHub repositories for term: multica
2026-08-07 22:30:05,183 - GitHubScraper - INFO - Total GitHub results found: 0
2026-08-07 22:30:06,274 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-07 22:30:06,670 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:06,681 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:06,753 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:06,768 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:07,040 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:07,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:07,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:07,339 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:07,425 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:07,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:07,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:07,771 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:07,781 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:07,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 22:30:07,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:08,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:08,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:08,309 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:08,434 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:08,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 22:30:08,665 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:08,668 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:08,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:08,818 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 22:30:08,935 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:08,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:09,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:09,369 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:09,588 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:09,643 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:09,684 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:09,700 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:09,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:10,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:10,340 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:10,376 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:10,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:10,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:10,823 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 22:30:10,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:10,887 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 22:30:10,981 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 22:30:11,188 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 22:30:11,274 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:11,393 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 22:30:11,408 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-07 22:30:11,573 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:11,674 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:11,876 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:11,885 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:11,895 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:12,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:12,206 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:12,249 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:12,281 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:12,397 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:12,565 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:12,617 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:12,698 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:12,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,069 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,152 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,316 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,459 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,694 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,727 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,792 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,839 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:13,985 - YouTubeIntelScraper - INFO - YouTube Intel found 55 candidates and 5 new videos
2026-08-07 22:30:14,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:14,146 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:14,148 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:14,188 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:14,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:14,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:14,501 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:14,588 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:14,750 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:14,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:14,940 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,010 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,067 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,363 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,402 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,708 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:15,781 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:16,070 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:16,080 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:16,082 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:16,100 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:16,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:16,413 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:16,415 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:16,577 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-07 22:30:16,638 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=0 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-07 22:30:16,639 - __main__ - INFO - Scraper github completed: 0 results
2026-08-07 22:30:16,639 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-07 22:30:16,639 - __main__ - INFO - Scraper youtube_intel completed: 5 results
2026-08-07 22:30:17,431 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-07 22:30:17.431476
2026-08-07 22:30:17,431 - __main__ - INFO - Email sent successfully
2026-08-07 22:30:17,431 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-07 22:30:17,432 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new youtube intel results.
2026-08-07 22:30:17,432 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-07 22:30:17,432 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-07 22:30:17,476 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-07 22:30:17,476 - __main__ - INFO - Closed all database connections
2026-08-07 22:30:17,478 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-07 22:30:17,478 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-07 23:00:02,206 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-07.log
2026-08-07 23:00:02,206 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-07.log
2026-08-07 23:00:02,206 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-07.log
2026-08-07 23:00:02,206 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-07 23:00:02,241 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-07 23:00:02,241 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-07 23:00:02,244 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-07 23:00:02,245 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-07 23:00:02,261 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-07 23:00:02,262 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-07 23:00:02,264 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-07 23:00:02,265 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-07 23:00:02,265 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-07 23:00:02,268 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-07 23:00:02,268 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-07 23:00:02,268 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-07 23:00:02,271 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-07 23:00:02,276 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-07 23:00:02,276 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-07 23:00:02,278 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-07 23:00:02,278 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-07 23:00:02,278 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-07 23:00:02,281 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-07 23:00:02,281 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-07 23:00:02,281 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-07 23:00:02,281 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-07 23:00:02,380 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-07 23:00:02,385 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-07 23:00:02,385 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-07 23:00:02,387 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-07 23:00:02,436 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-07 23:00:02,437 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-07 23:00:06,115 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-07 23:00:06,330 - Yiddish24Scraper - INFO - Received response with 438554 characters
2026-08-07 23:00:06,331 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292364 chars)
2026-08-07 23:00:06,332 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-07 23:00:06,401 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-07 23:00:06,442 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-07 23:00:06,442 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-07 23:00:07,377 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles
2026-08-07 23:00:07,377 - Yiddish24Scraper - INFO - Page 1: 1/100 new items
2026-08-07 23:00:07,377 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination
2026-08-07 23:00:07,378 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1
2026-08-07 23:00:14,431 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-07 23:00:25,162 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-08-07 23:00:25,162 - IveltScraper - INFO - All forums scrape complete. Found 10 new posts.
2026-08-07 23:00:25,162 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-07 23:00:25,163 - __main__ - INFO - Scraper yiddish24 completed: 1 results
2026-08-07 23:00:25,163 - __main__ - INFO - Scraper ivelt completed: 10 results
2026-08-07 23:00:25,800 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-07 23:00:25.800342
2026-08-07 23:00:25,800 - __main__ - INFO - Email sent successfully
2026-08-07 23:00:25,801 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-07 23:00:25,801 - __main__ - INFO - Monitor complete. Found 11 total results: 1 new yiddish24 results, 10 new ivelt results.
2026-08-07 23:00:25,801 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-07 23:00:25,801 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-07 23:00:26,000 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-07 23:00:26,001 - __main__ - INFO - Closed all database connections
2026-08-07 23:00:26,003 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-07 23:00:26,003 - social_media_monitor.database.connection - INFO - Closed 0 database connections