โ† Logs

social_media_monitor_2026-09-08.log

2026-09-08 20:30:02,557 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-08 20:30:02,557 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-08 20:30:02,561 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-08 20:30:02,566 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-08 20:30:02,566 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-08 20:30:02,569 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-08 20:30:02,569 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-08 20:30:02,569 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-08 20:30:02,575 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-08 20:30:02,576 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-08 20:30:02,576 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-08 20:30:02,577 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-08 20:30:03,020 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-08 20:30:03,022 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-08 20:30:03,683 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-08 20:30:03,708 - GitHubScraper - INFO - Found 594 GitHub repositories for term: "Hermes Agent"
2026-09-08 20:30:03,885 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-08 20:30:04,956 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-08 20:30:05,147 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-08 20:30:05,153 - GitHubScraper - INFO - Found 8584 GitHub repositories for term: "claude code"
2026-09-08 20:30:05,314 - GitHubScraper - INFO - Added new GitHub repository: ml-intern
2026-09-08 20:30:06,151 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-08 20:30:06,240 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-08 20:30:06,400 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-08 20:30:07,327 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-08 20:30:07,331 - GitHubScraper - INFO - Found 257 GitHub repositories for term: paperclip
2026-09-08 20:30:07,467 - GitHubScraper - INFO - Total GitHub results found: 1
2026-09-08 20:30:09,965 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-08 20:30:10,373 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:10,412 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:10,441 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:10,586 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:10,785 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:10,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 20:30:10,814 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:10,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:11,184 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:11,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:11,311 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:11,496 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:11,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:11,548 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:11,713 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:11,955 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:11,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:12,171 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:12,268 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:12,321 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 20:30:12,367 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:12,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:12,604 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:12,705 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:12,753 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:12,982 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:13,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:13,143 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:13,249 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:13,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:13,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:13,679 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:13,753 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:13,883 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:13,939 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:14,064 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:14,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 20:30:14,404 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:14,471 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:14,517 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 20:30:14,851 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:14,855 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:14,873 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:15,045 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 20:30:15,192 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:15,274 - YouTubeIntelScraper - INFO - YouTube Intel found 52 candidates and 7 new videos
2026-09-08 20:30:15,280 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:15,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:15,509 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:15,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:15,648 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:15,736 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:15,894 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:16,057 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:16,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 20:30:16,170 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:16,177 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:16,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:16,556 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:16,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 20:30:16,773 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 20:30:16,875 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:16,894 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:17,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:17,147 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:17,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:17,429 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:17,477 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:17,483 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:17,628 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:17,783 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:17,795 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:17,828 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:18,021 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:18,170 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:18,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:18,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:18,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:18,562 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:18,566 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:18,781 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:18,791 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:18,922 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:19,095 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:19,201 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:19,252 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:19,285 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:19,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:19,485 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:19,633 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:19,686 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:19,752 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:19,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:20,003 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:20,072 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:20,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:20,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:20,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:20,394 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:20,429 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 20:30:20,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 20:30:20,861 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=244 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-08 20:30:20,862 - __main__ - INFO - Scraper github completed: 1 results
2026-09-08 20:30:20,863 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-08 20:30:20,863 - __main__ - INFO - Scraper youtube_intel completed: 7 results
2026-09-08 20:30:21,515 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-08 20:30:21.515710
2026-09-08 20:30:21,516 - __main__ - INFO - Email sent successfully
2026-09-08 20:30:21,516 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-08 20:30:21,516 - __main__ - INFO - Monitor complete. Found 8 total results: 1 new github results, 7 new youtube intel results.
2026-09-08 20:30:21,516 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-08 20:30:21,516 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-08 20:30:21,543 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-08 20:30:21,543 - __main__ - INFO - Closed all database connections
2026-09-08 20:30:21,546 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-08 20:30:21,546 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-08 21:00:02,496 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-08.log
2026-09-08 21:00:02,496 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-08.log
2026-09-08 21:00:02,496 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-08.log
2026-09-08 21:00:02,496 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-08 21:00:02,529 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-08 21:00:02,529 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-08 21:00:02,532 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-08 21:00:02,533 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-08 21:00:02,544 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-08 21:00:02,544 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-08 21:00:02,548 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-08 21:00:02,550 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-08 21:00:02,550 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-08 21:00:02,555 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-08 21:00:02,555 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-08 21:00:02,555 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-08 21:00:02,561 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-08 21:00:02,567 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-08 21:00:02,567 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-08 21:00:02,570 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-08 21:00:02,570 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-08 21:00:02,570 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-08 21:00:02,573 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-08 21:00:02,573 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-08 21:00:02,573 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-08 21:00:02,574 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-08 21:00:02,662 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-08 21:00:02,666 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-08 21:00:02,666 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-08 21:00:02,667 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-08 21:00:02,950 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-08 21:00:03,425 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-08 21:00:03,647 - Yiddish24Scraper - INFO - Received response with 505753 characters
2026-09-08 21:00:03,648 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319704 chars)
2026-09-08 21:00:03,650 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-08 21:00:03,737 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-08 21:00:03,780 - Yiddish24Scraper - INFO - Page 1 extraction: 98 successful, 2 failed out of 100 elements
2026-09-08 21:00:03,780 - Yiddish24Scraper - INFO - Parsed 98 articles from HTML on page 1
2026-09-08 21:00:03,791 - Yiddish24Scraper - INFO - Term 'ืฆื•ื ืคื™ื ื˜ืœ -' matched in DESCRIPTION: 'ืฆื•ื ืคื™ื ื˜ืœ - ืื™ื– ื™ืขืฆื˜ ื“ื™ ืฆื™ื™ื˜ ืื™ื ื•ื•ืขืกื˜ื™ืจืŸ?'
2026-09-08 21:00:03,791 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-08 21:00:04,291 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/___________260_260908044228.mp3
2026-09-08 21:00:04,360 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2____________260_260908044228.mp3 (2.6 MB)
2026-09-08 21:00:04,361 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-08 21:00:04,365 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2____________260_260908044228.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-08 21:00:04,366 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2____________260_260908044228_ืฆื•ื_ืคื™ื ื˜ืœ_-.mp3
2026-09-08 21:00:04,419 - Yiddish24Scraper - INFO - Term 'ืื•ื™ืกืฆื•ื’ืŸ ืื•ืŸ ืงืจื™ืฉืงืขืœืขืš' matched in DESCRIPTION: 'ืื•ื™ืกืฆื•ื’ืŸ ืื•ืŸ ืงืจื™ืฉืงืขืœืขืš - ื—ื™ื–ื•ืง ืื•ืŸ ืืœืข ืฉื•ื•ืขืจืข ืฆื™ื™ื˜ืŸ'
2026-09-08 21:00:04,419 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-08 21:00:05,291 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_Vayelech__Day_3__R%27_Yoel_Lebovits_260_26_478407145.mp3
2026-09-08 21:00:06,388 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2__Vayelech__Day_3__R'_Yoel_Lebovits_260_26_478407145.mp3 (6.6 MB)
2026-09-08 21:00:06,388 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-08 21:00:06,397 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2__Vayelech__Day_3__R'_Yoel_Lebovits_260_26_478407145.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-08 21:00:06,397 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2__Vayelech__Day_3__R'_Yoel_Lebovits_260_26_478407145_ืื•ื™ืกืฆื•ื’ืŸ_ืื•ืŸ_ืงืจื™ืฉืงืขืœืขืš.mp3
2026-09-08 21:00:07,070 - Yiddish24Scraper - INFO - Page 1 summary: 9 new out of 98 total articles
2026-09-08 21:00:07,070 - Yiddish24Scraper - INFO - Page 1: 9/98 new items
2026-09-08 21:00:07,070 - Yiddish24Scraper - INFO - Low new item ratio (9.2%), stopping pagination
2026-09-08 21:00:07,070 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 9
2026-09-08 21:00:14,927 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-08 21:00:22,132 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.
2026-09-08 21:00:22,132 - IveltScraper - INFO - All forums scrape complete. Found 6 new posts.
2026-09-08 21:00:22,132 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-08 21:00:22,132 - __main__ - INFO - Scraper yiddish24 completed: 9 results
2026-09-08 21:00:22,132 - __main__ - INFO - Scraper ivelt completed: 6 results
2026-09-08 21:00:22,939 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-08 21:00:22.939274
2026-09-08 21:00:22,939 - __main__ - INFO - Email sent successfully
2026-09-08 21:00:22,939 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-08 21:00:22,940 - __main__ - INFO - Monitor complete. Found 15 total results: 9 new yiddish24 results, 6 new ivelt results.
2026-09-08 21:00:22,940 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-08 21:00:22,940 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-08 21:00:22,991 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-08 21:00:22,991 - __main__ - INFO - Closed all database connections
2026-09-08 21:00:22,993 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-08 21:00:22,993 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-08 22:00:02,575 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-08.log
2026-09-08 22:00:02,577 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-08.log
2026-09-08 22:00:02,577 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-08.log
2026-09-08 22:00:02,577 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-08 22:00:02,608 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-08 22:00:02,608 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-08 22:00:02,611 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-08 22:00:02,612 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-08 22:00:02,625 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-08 22:00:02,625 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-08 22:00:02,687 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-08 22:00:02,689 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-08 22:00:02,689 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-08 22:00:02,695 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-08 22:00:02,695 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-08 22:00:02,695 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-08 22:00:02,699 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-08 22:00:02,704 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-08 22:00:02,705 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-08 22:00:02,707 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-08 22:00:02,707 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-08 22:00:02,707 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-08 22:00:02,709 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-08 22:00:02,709 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-08 22:00:02,710 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-08 22:00:02,710 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-08 22:00:02,808 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-08 22:00:02,813 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-08 22:00:02,813 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-08 22:00:02,815 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-08 22:00:04,745 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-08 22:00:05,154 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-08 22:00:05,371 - Yiddish24Scraper - INFO - Received response with 514508 characters
2026-09-08 22:00:05,375 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (323582 chars)
2026-09-08 22:00:05,378 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-08 22:00:05,456 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-08 22:00:05,496 - Yiddish24Scraper - INFO - Page 1 extraction: 98 successful, 2 failed out of 100 elements
2026-09-08 22:00:05,496 - Yiddish24Scraper - INFO - Parsed 98 articles from HTML on page 1
2026-09-08 22:00:06,375 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 98 total articles
2026-09-08 22:00:06,376 - Yiddish24Scraper - INFO - Page 1: 4/98 new items
2026-09-08 22:00:06,376 - Yiddish24Scraper - INFO - Low new item ratio (4.1%), stopping pagination
2026-09-08 22:00:06,376 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4
2026-09-08 22:00:14,889 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-08 22:00:18,244 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-08 22:00:21,749 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-08 22:00:24,291 - IveltScraper - INFO - ivelt scrape complete. Checked 1 topics.
2026-09-08 22:00:24,291 - IveltScraper - INFO - All forums scrape complete. Found 13 new posts.
2026-09-08 22:00:24,292 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-08 22:00:24,292 - __main__ - INFO - Scraper yiddish24 completed: 4 results
2026-09-08 22:00:24,292 - __main__ - INFO - Scraper ivelt completed: 13 results
2026-09-08 22:00:25,219 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-08 22:00:25.219616
2026-09-08 22:00:25,219 - __main__ - INFO - Email sent successfully
2026-09-08 22:00:25,220 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-08 22:00:25,220 - __main__ - INFO - Monitor complete. Found 17 total results: 4 new yiddish24 results, 13 new ivelt results.
2026-09-08 22:00:25,220 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-08 22:00:25,220 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-08 22:00:25,379 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-08 22:00:25,379 - __main__ - INFO - Closed all database connections
2026-09-08 22:00:25,382 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-08 22:00:25,382 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-08 22:30:01,850 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-08.log
2026-09-08 22:30:01,850 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-08.log
2026-09-08 22:30:01,850 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-08.log
2026-09-08 22:30:01,850 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-08 22:30:01,883 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-08 22:30:01,884 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-08 22:30:01,887 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-08 22:30:01,887 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-08 22:30:01,902 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-08 22:30:01,902 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-08 22:30:01,908 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-08 22:30:01,909 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-08 22:30:01,910 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-08 22:30:01,910 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-08 22:30:01,916 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-08 22:30:01,916 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-08 22:30:01,921 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-08 22:30:01,928 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-08 22:30:01,928 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-08 22:30:01,931 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-08 22:30:01,931 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-08 22:30:01,931 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-08 22:30:01,933 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-08 22:30:01,933 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-08 22:30:01,933 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-08 22:30:01,933 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-08 22:30:02,542 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-08 22:30:02,544 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-08 22:30:03,261 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-08 22:30:03,329 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-08 22:30:03,354 - GitHubScraper - INFO - Found 594 GitHub repositories for term: "Hermes Agent"
2026-09-08 22:30:04,345 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-08 22:30:04,517 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-08 22:30:04,520 - GitHubScraper - INFO - Found 8582 GitHub repositories for term: "claude code"
2026-09-08 22:30:04,529 - GitHubScraper - INFO - Added new GitHub repository: agentuse
2026-09-08 22:30:04,544 - GitHubScraper - INFO - Added new GitHub repository: athfoujf
2026-09-08 22:30:05,534 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-08 22:30:05,538 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-08 22:30:05,709 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-08 22:30:06,594 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-08 22:30:06,598 - GitHubScraper - INFO - Found 257 GitHub repositories for term: paperclip
2026-09-08 22:30:06,764 - GitHubScraper - INFO - Total GitHub results found: 2
2026-09-08 22:30:09,253 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-08 22:30:09,627 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:09,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:09,718 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:09,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:10,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:10,113 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:10,205 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:10,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:10,509 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:10,564 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:10,638 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:10,808 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:10,820 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:10,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:11,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:11,211 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:11,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:11,357 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:11,534 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:11,551 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:11,590 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 22:30:11,739 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 22:30:11,931 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:11,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:12,017 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:12,100 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:12,361 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:12,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:12,491 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:12,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:12,761 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:12,860 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:12,955 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:13,001 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:13,203 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:13,330 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:13,409 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:13,453 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 22:30:13,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:13,761 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:13,941 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:13,943 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:14,002 - YouTubeIntelScraper - INFO - YouTube Intel found 53 candidates and 12 new videos
2026-09-08 22:30:14,067 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:14,178 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:14,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:14,443 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:14,469 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:14,536 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:14,713 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:14,822 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:14,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:14,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:15,036 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 22:30:15,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:15,242 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:15,357 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:15,534 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:15,786 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 22:30:15,799 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 22:30:15,804 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:15,980 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:16,102 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:16,163 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:16,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:16,311 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:16,517 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:16,533 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:16,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:16,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:16,894 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:16,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:17,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:17,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:17,330 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:17,420 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:17,424 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:17,487 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:17,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:17,813 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:17,868 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:17,912 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 22:30:18,089 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:18,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:18,267 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:18,297 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:18,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:18,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:18,540 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:18,681 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:18,729 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:18,802 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:18,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:19,008 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:19,055 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:19,218 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:19,220 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:19,274 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:19,325 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:19,624 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-08 22:30:19,723 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-08 22:30:19,883 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=244 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1
2026-09-08 22:30:19,884 - __main__ - INFO - Scraper github completed: 2 results
2026-09-08 22:30:19,884 - __main__ - INFO - Scraper github_feed completed: 1 results
2026-09-08 22:30:19,884 - __main__ - INFO - Scraper youtube_intel completed: 12 results
2026-09-08 22:30:20,471 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-08 22:30:20.471564
2026-09-08 22:30:20,471 - __main__ - INFO - Email sent successfully
2026-09-08 22:30:20,490 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed
2026-09-08 22:30:20,490 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-08 22:30:20,490 - __main__ - INFO - Monitor complete. Found 15 total results: 2 new github results, 1 new github feed results, 12 new youtube intel results.
2026-09-08 22:30:20,490 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-08 22:30:20,490 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-08 22:30:20,638 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-08 22:30:20,638 - __main__ - INFO - Closed all database connections
2026-09-08 22:30:20,641 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-08 22:30:20,641 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-08 23:00:01,928 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-08.log
2026-09-08 23:00:01,928 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-08.log
2026-09-08 23:00:01,928 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-08.log
2026-09-08 23:00:01,928 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-08 23:00:01,967 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-08 23:00:01,968 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-08 23:00:01,970 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-08 23:00:01,977 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-08 23:00:02,002 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-08 23:00:02,002 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-08 23:00:02,006 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-08 23:00:02,007 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-08 23:00:02,007 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-08 23:00:02,010 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-08 23:00:02,011 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-08 23:00:02,011 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-08 23:00:02,014 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-08 23:00:02,019 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-08 23:00:02,019 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-08 23:00:02,021 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-08 23:00:02,021 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-08 23:00:02,021 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-08 23:00:02,024 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-08 23:00:02,024 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-08 23:00:02,025 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-08 23:00:02,025 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-08 23:00:02,183 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-08 23:00:02,199 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-08 23:00:02,199 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-08 23:00:02,203 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-08 23:00:03,403 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-08 23:00:03,838 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-08 23:00:04,063 - Yiddish24Scraper - INFO - Received response with 517897 characters
2026-09-08 23:00:04,066 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318029 chars)
2026-09-08 23:00:04,068 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-08 23:00:04,136 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-08 23:00:04,175 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-09-08 23:00:04,175 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-09-08 23:00:04,310 - Yiddish24Scraper - INFO - Term 'ืื‘ืจื”ื ื”ืืœืคืจื™ืŸ' matched in DESCRIPTION: 'ื’ืขื“ืื ืงืŸ ืื•ืŸ ืื‘ื–ืขืจื•ื•ืืฆื™ืขืก - ืจ' ื–ืœืžืŸ ืœื™ื™ื‘ ืคืจืขื ืงืœ ืื•ืŸ ืจ' ืื‘ืจื”ื ื”ืืœืคืจื™ืŸ'
2026-09-08 23:00:04,310 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-08 23:00:04,811 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/LEIBY_AVRUMY_260_260908061059.mp3
2026-09-08 23:00:05,190 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_LEIBY_AVRUMY_260_260908061059.mp3 (7.2 MB)
2026-09-08 23:00:05,192 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-08 23:00:05,198 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_LEIBY_AVRUMY_260_260908061059.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-08 23:00:05,200 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_LEIBY_AVRUMY_260_260908061059_ืื‘ืจื”ื_ื”ืืœืคืจื™ืŸ.mp3
2026-09-08 23:00:06,348 - Yiddish24Scraper - INFO - Page 1 summary: 14 new out of 99 total articles
2026-09-08 23:00:06,348 - Yiddish24Scraper - INFO - Page 1: 14/99 new items
2026-09-08 23:00:06,348 - Yiddish24Scraper - INFO - Low new item ratio (14.1%), stopping pagination
2026-09-08 23:00:06,349 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 14
2026-09-08 23:00:14,735 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-08 23:00:28,609 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-08 23:00:49,399 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-08 23:00:49,399 - IveltScraper - INFO - All forums scrape complete. Found 38 new posts.
2026-09-08 23:00:49,400 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-08 23:00:49,400 - __main__ - INFO - Scraper yiddish24 completed: 14 results
2026-09-08 23:00:49,401 - __main__ - INFO - Scraper ivelt completed: 38 results
2026-09-08 23:00:50,380 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-08 23:00:50.380024
2026-09-08 23:00:50,380 - __main__ - INFO - Email sent successfully
2026-09-08 23:00:50,380 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-08 23:00:50,380 - __main__ - INFO - Monitor complete. Found 52 total results: 14 new yiddish24 results, 38 new ivelt results.
2026-09-08 23:00:50,380 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-08 23:00:50,380 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-08 23:00:50,465 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-08 23:00:50,465 - __main__ - INFO - Closed all database connections
2026-09-08 23:00:50,467 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-08 23:00:50,467 - social_media_monitor.database.connection - INFO - Closed 0 database connections