โ† Logs

social_media_monitor_2026-09-07.log

2026-09-07 20:30:02,232 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-07 20:30:02,232 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-07 20:30:02,291 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-07 20:30:02,292 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-07 20:30:02,292 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-07 20:30:02,293 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-07 20:30:02,299 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-07 20:30:02,299 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-07 20:30:02,305 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-07 20:30:02,311 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-07 20:30:02,311 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-07 20:30:02,313 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-07 20:30:02,313 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-07 20:30:02,313 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-07 20:30:02,315 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-07 20:30:02,316 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-07 20:30:02,316 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-07 20:30:02,316 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-07 20:30:02,841 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-07 20:30:02,842 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-07 20:30:03,467 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-07 20:30:03,555 - GitHubScraper - INFO - Found 591 GitHub repositories for term: "Hermes Agent"
2026-09-07 20:30:03,727 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-07 20:30:04,640 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-07 20:30:04,644 - GitHubScraper - INFO - Found 8539 GitHub repositories for term: "claude code"
2026-09-07 20:30:04,656 - GitHubScraper - INFO - Added new GitHub repository: fizzy-cli
2026-09-07 20:30:04,691 - GitHubScraper - INFO - Added new GitHub repository: freya
2026-09-07 20:30:04,745 - GitHubScraper - INFO - Added new GitHub repository: pgbot
2026-09-07 20:30:04,798 - GitHubScraper - INFO - Added new GitHub repository: awesome-spain
2026-09-07 20:30:04,828 - GitHubScraper - INFO - Added new GitHub repository: stavrobot
2026-09-07 20:30:04,917 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-07 20:30:05,696 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-07 20:30:05,699 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-07 20:30:06,124 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-07 20:30:06,770 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-07 20:30:06,773 - GitHubScraper - INFO - Found 257 GitHub repositories for term: paperclip
2026-09-07 20:30:06,899 - GitHubScraper - INFO - Total GitHub results found: 5
2026-09-07 20:30:09,304 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-07 20:30:09,793 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:09,868 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:09,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:10,169 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:10,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:10,272 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:10,551 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:10,629 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:10,632 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:10,860 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:10,954 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:10,976 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:10,989 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:11,266 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:11,404 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:11,430 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:11,585 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 20:30:11,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:11,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:11,992 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:12,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:12,217 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:12,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:12,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:12,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:12,540 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:12,772 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:12,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:12,926 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:12,954 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:13,156 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:13,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:13,492 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:13,534 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:13,562 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:14,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 20:30:14,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 20:30:14,163 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:14,466 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:14,624 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:14,683 - YouTubeIntelScraper - INFO - YouTube Intel found 52 candidates and 10 new videos
2026-09-07 20:30:14,743 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 20:30:14,966 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:15,000 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:15,011 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:15,411 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:15,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 20:30:15,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:15,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:15,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:16,065 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:16,147 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:16,149 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:16,152 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:16,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 20:30:16,557 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:16,687 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:16,691 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:17,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:17,037 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 20:30:17,163 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:17,248 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:17,445 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:17,455 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:17,568 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:17,668 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:17,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:17,783 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:17,942 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:18,092 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:18,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:18,178 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:18,378 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:18,518 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 20:30:18,529 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:18,579 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:18,746 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:18,902 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:19,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:19,079 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:19,146 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 20:30:19,393 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:19,459 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:19,479 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 20:30:19,595 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:19,795 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:19,821 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:20,005 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:20,210 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:20,238 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:20,342 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:20,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:20,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:20,731 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:20,888 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:21,040 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:21,107 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:21,203 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:21,272 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:21,418 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:21,662 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 20:30:21,744 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=243 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-07 20:30:21,746 - __main__ - INFO - Scraper github completed: 5 results
2026-09-07 20:30:21,746 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-07 20:30:21,746 - __main__ - INFO - Scraper youtube_intel completed: 10 results
2026-09-07 20:30:22,318 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-07 20:30:22.318763
2026-09-07 20:30:22,319 - __main__ - INFO - Email sent successfully
2026-09-07 20:30:22,319 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-07 20:30:22,319 - __main__ - INFO - Monitor complete. Found 15 total results: 5 new github results, 10 new youtube intel results.
2026-09-07 20:30:22,319 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-07 20:30:22,319 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-07 20:30:22,384 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-07 20:30:22,385 - __main__ - INFO - Closed all database connections
2026-09-07 20:30:22,387 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-07 20:30:22,387 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-07 21:00:01,757 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-07.log
2026-09-07 21:00:01,757 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-07.log
2026-09-07 21:00:01,757 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-07.log
2026-09-07 21:00:01,758 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-07 21:00:01,787 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-07 21:00:01,787 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-07 21:00:01,789 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-07 21:00:01,790 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-07 21:00:01,803 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-07 21:00:01,803 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-07 21:00:01,808 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-07 21:00:01,811 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-07 21:00:01,811 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-07 21:00:01,818 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-07 21:00:01,818 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-07 21:00:01,818 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-07 21:00:01,823 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-07 21:00:01,828 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-07 21:00:01,828 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-07 21:00:01,830 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-07 21:00:01,830 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-07 21:00:01,830 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-07 21:00:01,832 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-07 21:00:01,832 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-07 21:00:01,833 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-07 21:00:01,833 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-07 21:00:01,921 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-07 21:00:01,926 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-07 21:00:01,926 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-07 21:00:01,927 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-07 21:00:02,251 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-07 21:00:02,721 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-07 21:00:02,936 - Yiddish24Scraper - INFO - Received response with 493627 characters
2026-09-07 21:00:02,940 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (309077 chars)
2026-09-07 21:00:02,943 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-07 21:00:03,043 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-07 21:00:03,087 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-07 21:00:03,088 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-07 21:00:03,712 - Yiddish24Scraper - INFO - Term 'ืื‘ืจื”ื ื”ืืœืคืจื™ืŸ' matched in DESCRIPTION: 'ื”ืจื‘ ืื‘ืจื”ื ื”ืืœืคืจื™ืŸ'
2026-09-07 21:00:03,713 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: "ืกื’ื•ืœื” ื‘ื“ื•ืง ื•ืžื ื•ืกื” ืคืืจ ื ื ื™ื™ ื™ืืจ ื”ื‘ืขืœ"
2026-09-07 21:00:04,241 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_235_1788812816.mp3
2026-09-07 21:00:05,123 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_235_1788812816.mp3 (1.5 MB)
2026-09-07 21:00:05,123 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-07 21:00:05,131 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_235_1788812816.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-07 21:00:05,131 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_235_1788812816_ืื‘ืจื”ื_ื”ืืœืคืจื™ืŸ.mp3
2026-09-07 21:00:05,836 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 100 total articles
2026-09-07 21:00:05,836 - Yiddish24Scraper - INFO - Page 1: 11/100 new items
2026-09-07 21:00:05,836 - Yiddish24Scraper - INFO - Low new item ratio (11.0%), stopping pagination
2026-09-07 21:00:05,837 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-09-07 21:00:16,012 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-07 21:00:34,674 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-09-07 21:00:34,674 - IveltScraper - INFO - All forums scrape complete. Found 11 new posts.
2026-09-07 21:00:34,675 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-07 21:00:34,675 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-09-07 21:00:34,675 - __main__ - INFO - Scraper ivelt completed: 11 results
2026-09-07 21:00:35,897 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-07 21:00:35.897822
2026-09-07 21:00:35,898 - __main__ - INFO - Email sent successfully
2026-09-07 21:00:35,898 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-07 21:00:35,898 - __main__ - INFO - Monitor complete. Found 22 total results: 11 new yiddish24 results, 11 new ivelt results.
2026-09-07 21:00:35,898 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-07 21:00:35,898 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-07 21:00:35,940 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-07 21:00:35,940 - __main__ - INFO - Closed all database connections
2026-09-07 21:00:35,942 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-07 21:00:35,942 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-07 22:00:02,202 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-07.log
2026-09-07 22:00:02,202 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-07.log
2026-09-07 22:00:02,202 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-07.log
2026-09-07 22:00:02,202 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-07 22:00:02,231 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-07 22:00:02,231 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-07 22:00:02,233 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-07 22:00:02,234 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-07 22:00:02,248 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-07 22:00:02,248 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-07 22:00:02,309 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-07 22:00:02,311 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-07 22:00:02,311 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-07 22:00:02,317 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-07 22:00:02,317 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-07 22:00:02,318 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-07 22:00:02,322 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-07 22:00:02,329 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-07 22:00:02,329 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-07 22:00:02,331 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-07 22:00:02,331 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-07 22:00:02,331 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-07 22:00:02,333 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-07 22:00:02,334 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-07 22:00:02,334 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-07 22:00:02,334 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-07 22:00:02,448 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-07 22:00:02,455 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-07 22:00:02,455 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-07 22:00:02,459 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-07 22:00:02,727 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-07 22:00:03,030 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-07 22:00:03,135 - Yiddish24Scraper - INFO - Received response with 496334 characters
2026-09-07 22:00:03,137 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (309596 chars)
2026-09-07 22:00:03,139 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-07 22:00:03,221 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-07 22:00:03,266 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-07 22:00:03,266 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-07 22:00:03,844 - Yiddish24Scraper - INFO - Term 'ื‘ื“ื—ืŸ' matched in DESCRIPTION: 'ื’ืจืืžืขืŸ ืฆื•ื ื ื™ื™ืขื ื™ืืจ ื“ื•ืจืš ื“ื™ ื‘ื“ื—ืŸ ืจ' ื™ื•ืืœ ืคื™ื™ืขืจืฉื˜ื™ื™ืŸ'
2026-09-07 22:00:03,844 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-07 22:00:04,345 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_____________________________%27%27___________338789738.mp3
2026-09-07 22:00:05,239 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2______________________________''___________338789738.mp3 (1.7 MB)
2026-09-07 22:00:05,240 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-07 22:00:05,250 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2______________________________''___________338789738.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-07 22:00:05,250 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2______________________________''___________338789738_ื‘ื“ื—ืŸ.mp3
2026-09-07 22:00:06,005 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-09-07 22:00:06,006 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-09-07 22:00:06,006 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-09-07 22:00:06,007 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-09-07 22:00:16,079 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-07 22:00:16,084 - IveltScraper - INFO - ivelt scrape complete. Checked 0 topics.
2026-09-07 22:00:16,084 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-07 22:00:16,084 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-07 22:00:16,084 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-09-07 22:00:16,084 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-07 22:00:16,774 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-07 22:00:16.774300
2026-09-07 22:00:16,774 - __main__ - INFO - Email sent successfully
2026-09-07 22:00:16,774 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-07 22:00:16,775 - __main__ - INFO - Monitor complete. Found 6 total results: 6 new yiddish24 results.
2026-09-07 22:00:16,775 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-07 22:00:16,775 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-07 22:00:16,875 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-07 22:00:16,875 - __main__ - INFO - Closed all database connections
2026-09-07 22:00:16,877 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-07 22:00:16,877 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-07 22:30:01,933 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-07.log
2026-09-07 22:30:01,933 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-07.log
2026-09-07 22:30:01,933 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-07.log
2026-09-07 22:30:01,933 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-07 22:30:01,961 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-07 22:30:01,961 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-07 22:30:01,963 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-07 22:30:01,964 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-07 22:30:01,978 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-07 22:30:01,978 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-07 22:30:01,981 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-07 22:30:01,982 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-07 22:30:01,982 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-07 22:30:01,982 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-07 22:30:01,987 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-07 22:30:01,987 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-07 22:30:01,991 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-07 22:30:01,995 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-07 22:30:01,995 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-07 22:30:01,997 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-07 22:30:01,997 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-07 22:30:01,997 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-07 22:30:02,000 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-07 22:30:02,000 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-07 22:30:02,000 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-07 22:30:02,000 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-07 22:30:02,473 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-07 22:30:02,474 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-07 22:30:03,218 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-07 22:30:03,268 - GitHubScraper - INFO - Found 591 GitHub repositories for term: "Hermes Agent"
2026-09-07 22:30:03,418 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-07 22:30:04,249 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-07 22:30:04,339 - GitHubScraper - INFO - Found 8545 GitHub repositories for term: "claude code"
2026-09-07 22:30:04,410 - GitHubScraper - INFO - Added new GitHub repository: mcp_flutter
2026-09-07 22:30:04,487 - GitHubScraper - INFO - Added new GitHub repository: tolaria
2026-09-07 22:30:04,526 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-07 22:30:05,324 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-07 22:30:05,329 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-07 22:30:05,791 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:05,791 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-07 22:30:06,420 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-07 22:30:06,424 - GitHubScraper - INFO - Found 257 GitHub repositories for term: paperclip
2026-09-07 22:30:06,560 - GitHubScraper - INFO - Total GitHub results found: 2
2026-09-07 22:30:08,809 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-07 22:30:09,146 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:09,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:09,340 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:09,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:09,619 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 22:30:09,630 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:09,662 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:09,821 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:09,968 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:10,037 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:10,233 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:10,243 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:10,333 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:10,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:10,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:10,691 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:10,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 22:30:10,824 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:11,026 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:11,129 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:11,203 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:11,290 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:11,457 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:11,477 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:11,529 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:11,599 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:11,866 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 22:30:11,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:11,969 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:12,072 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:12,209 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:12,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:12,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:12,595 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:12,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:12,801 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:12,993 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 22:30:13,104 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:13,112 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 22:30:13,147 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:13,434 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:13,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:13,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 22:30:13,665 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 22:30:13,851 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 22:30:14,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,024 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,038 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,147 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,181 - YouTubeIntelScraper - INFO - YouTube Intel found 51 candidates and 10 new videos
2026-09-07 22:30:14,388 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,467 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,783 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,912 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:14,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:15,382 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:15,385 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-07 22:30:15,452 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:15,455 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:15,751 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:15,781 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:15,813 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:15,869 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:16,149 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:16,190 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:16,212 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:16,246 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:16,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:16,771 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:16,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:16,975 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:17,203 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:17,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:17,288 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:17,689 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:17,691 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:17,762 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,042 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,097 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,132 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,477 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,497 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,775 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,832 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,847 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:18,898 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:19,077 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:19,132 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:19,216 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:19,306 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:19,484 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:19,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:19,608 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:19,655 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:19,989 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-07 22:30:20,052 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-07 22:30:20,054 - __main__ - INFO - Scraper github completed: 2 results
2026-09-07 22:30:20,054 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-07 22:30:20,054 - __main__ - INFO - Scraper youtube_intel completed: 10 results
2026-09-07 22:30:20,742 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-07 22:30:20.741943
2026-09-07 22:30:20,742 - __main__ - INFO - Email sent successfully
2026-09-07 22:30:20,742 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-07 22:30:20,742 - __main__ - INFO - Monitor complete. Found 12 total results: 2 new github results, 10 new youtube intel results.
2026-09-07 22:30:20,742 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-07 22:30:20,742 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-07 22:30:20,803 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-07 22:30:20,804 - __main__ - INFO - Closed all database connections
2026-09-07 22:30:20,806 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-07 22:30:20,806 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-07 23:00:01,892 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-07.log
2026-09-07 23:00:01,892 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-07.log
2026-09-07 23:00:01,892 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-07.log
2026-09-07 23:00:01,892 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-07 23:00:01,922 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-07 23:00:01,922 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-07 23:00:01,924 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-07 23:00:01,925 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-07 23:00:01,941 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-07 23:00:01,941 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-07 23:00:01,947 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-07 23:00:01,949 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-07 23:00:01,949 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-07 23:00:01,957 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-07 23:00:01,957 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-07 23:00:01,957 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-07 23:00:01,961 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-07 23:00:01,966 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-07 23:00:01,966 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-07 23:00:01,969 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-07 23:00:01,969 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-07 23:00:01,969 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-07 23:00:01,972 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-07 23:00:01,972 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-07 23:00:01,972 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-07 23:00:01,972 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-07 23:00:02,061 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-07 23:00:02,065 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-07 23:00:02,065 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-07 23:00:02,067 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-07 23:00:02,377 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-07 23:00:04,477 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-07 23:00:04,693 - Yiddish24Scraper - INFO - Received response with 493388 characters
2026-09-07 23:00:04,695 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313713 chars)
2026-09-07 23:00:04,697 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-07 23:00:04,780 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-07 23:00:04,819 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-09-07 23:00:04,819 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-09-07 23:00:05,579 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 99 total articles
2026-09-07 23:00:05,579 - Yiddish24Scraper - INFO - Page 1: 11/99 new items
2026-09-07 23:00:05,579 - Yiddish24Scraper - INFO - Low new item ratio (11.1%), stopping pagination
2026-09-07 23:00:05,580 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-09-07 23:00:14,409 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-07 23:00:26,321 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-09-07 23:00:26,321 - IveltScraper - INFO - All forums scrape complete. Found 11 new posts.
2026-09-07 23:00:26,321 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-07 23:00:26,321 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-09-07 23:00:26,321 - __main__ - INFO - Scraper ivelt completed: 11 results
2026-09-07 23:00:26,987 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-07 23:00:26.987729
2026-09-07 23:00:26,988 - __main__ - INFO - Email sent successfully
2026-09-07 23:00:26,988 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-07 23:00:26,988 - __main__ - INFO - Monitor complete. Found 22 total results: 11 new yiddish24 results, 11 new ivelt results.
2026-09-07 23:00:26,988 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-07 23:00:26,988 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-07 23:00:27,090 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-07 23:00:27,091 - __main__ - INFO - Closed all database connections
2026-09-07 23:00:27,093 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-07 23:00:27,093 - social_media_monitor.database.connection - INFO - Closed 0 database connections