โ† Logs

social_media_monitor_2026-08-04.log

2026-08-04 20:30:02,341 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:iOS development: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 20:30:02,341 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Android development: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 20:30:02,342 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Swift programming: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 20:30:02,343 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Kotlin development: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 20:30:02,343 - YouTubeIntelScraper - INFO - YouTube Intel found 0 candidates and 0 new videos
2026-08-04 20:30:02,691 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-04 20:30:02,692 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-04 20:30:03,354 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-04 20:30:03,452 - GitHubScraper - INFO - Found 247 GitHub repositories for term: paperclip
2026-08-04 20:30:03,649 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-08-04 20:30:04,531 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-04 20:30:04,558 - GitHubScraper - INFO - Found 498 GitHub repositories for term: "Hermes Agent"
2026-08-04 20:30:04,574 - GitHubScraper - INFO - Added new GitHub repository: push
2026-08-04 20:30:04,751 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-04 20:30:05,517 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-04 20:30:05,520 - GitHubScraper - INFO - Found 57 GitHub repositories for term: multica
2026-08-04 20:30:05,735 - GitHubScraper - INFO - Total GitHub results found: 1
2026-08-04 20:30:06,003 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:06,004 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-08-04 20:30:09,212 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-04 20:30:09,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:09,668 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:09,737 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:09,773 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:09,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:10,194 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:10,197 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:10,301 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:10,515 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:10,517 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:10,604 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:10,888 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:10,927 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:11,015 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:11,156 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:11,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:11,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:11,576 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:11,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:11,739 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:11,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:12,005 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:12,109 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:12,112 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:12,395 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:12,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:12,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:12,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:12,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:13,017 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:13,072 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:13,125 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/abdsaleh306090/medsynth/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:13,337 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:13,571 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:13,573 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:13,659 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:13,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:13,919 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:14,078 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:14,146 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:14,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:14,432 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/safimomin/Kofax-PaperPort-Portable-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:14,475 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:14,556 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:14,791 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:14,970 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:15,004 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:15,048 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:15,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:15,302 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:15,406 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:15,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:15,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:15,740 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:15,842 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:16,120 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:16,129 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:16,225 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:16,296 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:16,530 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:16,546 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rakia-app/rakia-content/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:16,592 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:16,924 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:16,953 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:17,096 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:17,210 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 20:30:17,435 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:17,568 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:17,570 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:17,839 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:17,909 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/gemaraproj/gemara-publish-action/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:17,940 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:17,983 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:18,187 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:18,300 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:18,333 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:18,471 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:18,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:18,651 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:18,733 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:18,792 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:18,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,003 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,115 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,330 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,438 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,495 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,854 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:19,924 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:20,188 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:20,191 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:20,258 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:20,350 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:20,511 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:20,638 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:20,677 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 20:30:20,827 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-04 20:30:20,828 - __main__ - INFO - Scraper github completed: 1 results
2026-08-04 20:30:20,828 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-04 20:30:20,828 - __main__ - INFO - Scraper youtube_intel completed: 0 results
2026-08-04 20:30:21,497 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-04 20:30:21.497822
2026-08-04 20:30:21,498 - __main__ - INFO - Email sent successfully
2026-08-04 20:30:21,498 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-04 20:30:21,498 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new github results.
2026-08-04 20:30:21,498 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-04 20:30:21,498 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-04 20:30:21,524 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-04 20:30:21,524 - __main__ - INFO - Closed all database connections
2026-08-04 20:30:21,526 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-04 20:30:21,526 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-04 21:00:02,388 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-04.log
2026-08-04 21:00:02,388 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-04.log
2026-08-04 21:00:02,388 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-04.log
2026-08-04 21:00:02,388 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-04 21:00:02,437 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-04 21:00:02,437 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-04 21:00:02,441 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-04 21:00:02,442 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-04 21:00:02,897 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-04 21:00:02,897 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-04 21:00:02,957 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-08-04 21:00:02,958 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-04 21:00:02,958 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-04 21:00:02,966 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-04 21:00:02,966 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-04 21:00:02,966 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-04 21:00:02,972 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-04 21:00:02,983 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-04 21:00:02,983 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-04 21:00:02,989 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-04 21:00:02,989 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-04 21:00:02,990 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-04 21:00:02,995 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-04 21:00:02,995 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-04 21:00:02,995 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-04 21:00:02,996 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-04 21:00:03,084 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-04 21:00:03,088 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-04 21:00:03,088 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-04 21:00:03,089 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-04 21:00:03,208 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-04 21:00:03,210 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-04 21:00:06,678 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-04 21:00:06,891 - Yiddish24Scraper - INFO - Received response with 483315 characters
2026-08-04 21:00:06,894 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (307934 chars)
2026-08-04 21:00:06,897 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-04 21:00:06,986 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-04 21:00:07,026 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-04 21:00:07,027 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-04 21:00:07,110 - Yiddish24Scraper - INFO - Term 'ืื™ื‘ืขืจ ื“ืืก ืื•ืŸ ื™ืขื ืฅ -' matched in DESCRIPTION: 'ืื™ื‘ืขืจ ื“ืืก ืื•ืŸ ื™ืขื ืฅ - ื‘ืื•ื•ืืจืคืŸ ื“ืขื ืฉื“ื›ืŸ ืžื™ื˜ ืฉื˜ื™ื™ื ืขืจ'
2026-08-04 21:00:07,110 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-04 21:00:07,610 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/DUS_IN_YENTZ_shiddichim_A_260_260804042417.mp3
2026-08-04 21:00:07,848 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_DUS_IN_YENTZ_shiddichim_A_260_260804042417.mp3 (28.6 MB)
2026-08-04 21:00:07,848 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-04 21:00:07,862 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_DUS_IN_YENTZ_shiddichim_A_260_260804042417.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-04 21:00:07,862 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_DUS_IN_YENTZ_shiddichim_A_260_260804042417_ืื™ื‘ืขืจ_ื“ืืก_ืื•ืŸ_ื™ืขื ืฅ_-.mp3
2026-08-04 21:00:08,502 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-08-04 21:00:08,502 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-08-04 21:00:08,502 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-08-04 21:00:08,503 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-08-04 21:00:15,243 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-04 21:00:37,579 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-08-04 21:00:37,579 - IveltScraper - INFO - All forums scrape complete. Found 42 new posts.
2026-08-04 21:00:37,580 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-04 21:00:37,580 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-08-04 21:00:37,580 - __main__ - INFO - Scraper ivelt completed: 42 results
2026-08-04 21:00:38,555 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-04 21:00:38.555509
2026-08-04 21:00:38,555 - __main__ - INFO - Email sent successfully
2026-08-04 21:00:38,556 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-04 21:00:38,556 - __main__ - INFO - Monitor complete. Found 48 total results: 6 new yiddish24 results, 42 new ivelt results.
2026-08-04 21:00:38,556 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-04 21:00:38,556 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-04 21:00:38,612 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-04 21:00:38,612 - __main__ - INFO - Closed all database connections
2026-08-04 21:00:38,614 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-04 21:00:38,614 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-04 22:00:02,069 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-04.log
2026-08-04 22:00:02,070 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-04.log
2026-08-04 22:00:02,070 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-04.log
2026-08-04 22:00:02,070 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-04 22:00:02,101 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-04 22:00:02,101 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-04 22:00:02,103 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-04 22:00:02,104 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-04 22:00:02,119 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-04 22:00:02,119 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-04 22:00:02,122 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-08-04 22:00:02,123 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-04 22:00:02,123 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-04 22:00:02,125 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-04 22:00:02,125 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-04 22:00:02,125 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-04 22:00:02,128 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-04 22:00:02,132 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-04 22:00:02,132 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-04 22:00:02,134 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-04 22:00:02,134 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-04 22:00:02,134 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-04 22:00:02,137 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-04 22:00:02,137 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-04 22:00:02,137 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-04 22:00:02,137 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-04 22:00:02,223 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-04 22:00:02,227 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-04 22:00:02,228 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-04 22:00:02,229 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-04 22:00:02,365 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-04 22:00:02,367 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-04 22:00:05,885 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-04 22:00:06,096 - Yiddish24Scraper - INFO - Received response with 468022 characters
2026-08-04 22:00:06,099 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (303172 chars)
2026-08-04 22:00:06,102 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-04 22:00:06,195 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-04 22:00:06,242 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-04 22:00:06,242 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-04 22:00:06,309 - Yiddish24Scraper - INFO - Term 'ืขื ื™ื ื™ื ืฉื•ื ื™ื' matched in DESCRIPTION: 'ืขื ื™ื ื™ื ืฉื•ื ื™ื - ืžืขืจ ืื•ื™ืคื˜ื• ืื“ืขืจ ืžืขืจ ื—ื•ืจื‘ืŸ?'
2026-08-04 22:00:06,309 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-04 22:00:06,810 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_______260_260804043500.mp3
2026-08-04 22:00:07,047 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2________260_260804043500.mp3 (21.0 MB)
2026-08-04 22:00:07,047 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-04 22:00:07,057 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2________260_260804043500.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-04 22:00:07,058 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2________260_260804043500_ืขื ื™ื ื™ื_ืฉื•ื ื™ื.mp3
2026-08-04 22:00:07,721 - Yiddish24Scraper - INFO - Page 1 summary: 9 new out of 100 total articles
2026-08-04 22:00:07,721 - Yiddish24Scraper - INFO - Page 1: 9/100 new items
2026-08-04 22:00:07,721 - Yiddish24Scraper - INFO - Low new item ratio (9.0%), stopping pagination
2026-08-04 22:00:07,722 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 9
2026-08-04 22:00:14,564 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-04 22:00:29,278 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-08-04 22:00:32,976 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-08-04 22:00:32,976 - IveltScraper - INFO - All forums scrape complete. Found 7 new posts.
2026-08-04 22:00:32,977 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-04 22:00:32,977 - __main__ - INFO - Scraper yiddish24 completed: 9 results
2026-08-04 22:00:32,977 - __main__ - INFO - Scraper ivelt completed: 7 results
2026-08-04 22:00:33,745 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-04 22:00:33.745685
2026-08-04 22:00:33,745 - __main__ - INFO - Email sent successfully
2026-08-04 22:00:33,746 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-04 22:00:33,746 - __main__ - INFO - Monitor complete. Found 16 total results: 9 new yiddish24 results, 7 new ivelt results.
2026-08-04 22:00:33,746 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-04 22:00:33,746 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-04 22:00:33,783 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-04 22:00:33,783 - __main__ - INFO - Closed all database connections
2026-08-04 22:00:33,785 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-04 22:00:33,785 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-04 22:30:02,444 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-04.log
2026-08-04 22:30:02,444 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-04.log
2026-08-04 22:30:02,444 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-04.log
2026-08-04 22:30:02,444 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-04 22:30:02,478 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-04 22:30:02,478 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-04 22:30:02,481 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-04 22:30:02,487 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-04 22:30:02,500 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-04 22:30:02,500 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-04 22:30:02,647 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-08-04 22:30:02,648 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-04 22:30:02,648 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-04 22:30:02,650 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-04 22:30:02,657 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-04 22:30:02,658 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-04 22:30:02,662 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-04 22:30:02,667 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-04 22:30:02,667 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-04 22:30:02,673 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-04 22:30:02,673 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-04 22:30:02,673 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-04 22:30:02,678 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-04 22:30:02,678 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-04 22:30:02,678 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-04 22:30:02,678 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-04 22:30:02,902 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for https://www.youtube.com/feed/subscriptions: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,903 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:OmniRoute: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,905 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Buzz: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,906 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Paperclip: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,907 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Multica: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,907 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:mobile app development: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,908 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:React Native: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,909 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Flutter mobile development: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,909 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:iOS development: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,910 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Android development: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,911 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Swift programming: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,912 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Kotlin development: [Errno 2] No such file or directory: 'yt-dlp'
2026-08-04 22:30:02,912 - YouTubeIntelScraper - INFO - YouTube Intel found 0 candidates and 0 new videos
2026-08-04 22:30:03,230 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-04 22:30:03,231 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-04 22:30:03,922 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-04 22:30:03,947 - GitHubScraper - INFO - Found 247 GitHub repositories for term: paperclip
2026-08-04 22:30:04,271 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-08-04 22:30:05,062 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-04 22:30:05,067 - GitHubScraper - INFO - Found 498 GitHub repositories for term: "Hermes Agent"
2026-08-04 22:30:05,340 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-04 22:30:06,115 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-04 22:30:06,119 - GitHubScraper - INFO - Found 57 GitHub repositories for term: multica
2026-08-04 22:30:06,290 - GitHubScraper - INFO - Total GitHub results found: 0
2026-08-04 22:30:06,728 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-08-04 22:30:10,374 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-04 22:30:10,810 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:10,887 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:10,893 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:10,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:11,340 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:11,346 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:11,395 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:11,654 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:11,786 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:11,789 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:11,818 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:12,120 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:12,201 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:12,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:12,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 22:30:12,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:12,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:12,866 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:12,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:12,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 22:30:13,160 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:13,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:13,281 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:13,383 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 22:30:13,547 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:13,579 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:13,708 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:14,045 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:14,079 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:14,192 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:14,468 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:14,470 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:14,537 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/abdsaleh306090/medsynth/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:14,606 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:14,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:14,968 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:15,095 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:15,145 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:15,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:15,439 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 22:30:15,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 22:30:15,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 22:30:15,830 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/safimomin/Kofax-PaperPort-Portable-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 22:30:15,871 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:16,033 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:16,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:16,217 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 22:30:16,246 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 22:30:16,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:16,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:16,630 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:16,673 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:16,858 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:16,998 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:17,191 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:17,250 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:17,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:17,435 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:17,550 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:17,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:17,718 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:17,919 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rakia-app/rakia-content/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-04 22:30:18,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:18,230 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:18,421 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:18,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:18,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:18,752 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:18,771 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:18,977 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/gemaraproj/gemara-publish-action/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:19,090 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:19,101 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:19,212 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:19,392 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:19,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:19,612 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:19,716 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:19,775 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:19,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,159 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,217 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,519 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,526 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,957 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:20,969 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:21,005 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:21,398 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:21,464 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:21,496 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:21,589 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:21,773 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:21,866 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:21,867 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:21,968 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:22,155 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-04 22:30:22,220 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=299 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1
2026-08-04 22:30:22,221 - __main__ - INFO - Scraper github completed: 0 results
2026-08-04 22:30:22,222 - __main__ - INFO - Scraper github_feed completed: 1 results
2026-08-04 22:30:22,222 - __main__ - INFO - Scraper youtube_intel completed: 0 results
2026-08-04 22:30:22,970 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-04 22:30:22.970089
2026-08-04 22:30:22,970 - __main__ - INFO - Email sent successfully
2026-08-04 22:30:22,981 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed
2026-08-04 22:30:22,982 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-04 22:30:22,982 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new github feed results.
2026-08-04 22:30:22,982 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-04 22:30:22,982 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-04 22:30:22,996 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-04 22:30:22,997 - __main__ - INFO - Closed all database connections
2026-08-04 22:30:22,999 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-04 22:30:22,999 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-04 23:00:02,109 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-04.log
2026-08-04 23:00:02,110 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-04.log
2026-08-04 23:00:02,110 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-04.log
2026-08-04 23:00:02,110 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-04 23:00:02,140 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-04 23:00:02,141 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-04 23:00:02,143 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-04 23:00:02,143 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-04 23:00:02,159 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-04 23:00:02,159 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-04 23:00:02,165 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-08-04 23:00:02,166 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-04 23:00:02,166 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-04 23:00:02,173 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-04 23:00:02,173 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-04 23:00:02,173 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-04 23:00:02,180 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-04 23:00:02,192 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-04 23:00:02,192 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-04 23:00:02,196 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-04 23:00:02,196 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-04 23:00:02,197 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-04 23:00:02,200 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-04 23:00:02,200 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-04 23:00:02,201 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-04 23:00:02,201 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-04 23:00:02,323 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-04 23:00:02,334 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-04 23:00:02,335 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-04 23:00:02,337 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-04 23:00:02,415 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-04 23:00:02,417 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-04 23:00:09,833 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-04 23:00:10,055 - Yiddish24Scraper - INFO - Received response with 483863 characters
2026-08-04 23:00:10,059 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (309254 chars)
2026-08-04 23:00:10,062 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-04 23:00:10,156 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-04 23:00:10,200 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-04 23:00:10,200 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-04 23:00:10,216 - Yiddish24Scraper - INFO - Term 'ื ื’ื•ื˜ ื•ื•ืืจื˜' matched in DESCRIPTION: 'ื ื’ื•ื˜ ื•ื•ืืจื˜ - ืื™ืจ ืงืขื ื˜ ืจืขื“ืŸ ืคืืจ ืฆื•ื•ื™ื™ ืื•ืŸ ื ื”ืืœื‘ ืžื™ื ื•ื˜'
2026-08-04 23:00:10,216 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-04 23:00:10,717 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/leiby_avrumy__260_260804045849.mp3
2026-08-04 23:00:11,864 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_leiby_avrumy__260_260804045849.mp3 (6.6 MB)
2026-08-04 23:00:11,865 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-04 23:00:11,879 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_leiby_avrumy__260_260804045849.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-04 23:00:11,879 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_leiby_avrumy__260_260804045849_ื_ื’ื•ื˜_ื•ื•ืืจื˜.mp3
2026-08-04 23:00:13,100 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 100 total articles
2026-08-04 23:00:13,100 - Yiddish24Scraper - INFO - Page 1: 11/100 new items
2026-08-04 23:00:13,100 - Yiddish24Scraper - INFO - Low new item ratio (11.0%), stopping pagination
2026-08-04 23:00:13,101 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-08-04 23:00:14,333 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-04 23:00:26,292 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.
2026-08-04 23:00:26,293 - IveltScraper - INFO - All forums scrape complete. Found 16 new posts.
2026-08-04 23:00:26,293 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-04 23:00:26,293 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-08-04 23:00:26,293 - __main__ - INFO - Scraper ivelt completed: 16 results
2026-08-04 23:00:27,144 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-04 23:00:27.144245
2026-08-04 23:00:27,144 - __main__ - INFO - Email sent successfully
2026-08-04 23:00:27,145 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-04 23:00:27,145 - __main__ - INFO - Monitor complete. Found 27 total results: 11 new yiddish24 results, 16 new ivelt results.
2026-08-04 23:00:27,145 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-04 23:00:27,145 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-04 23:00:27,314 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-04 23:00:27,314 - __main__ - INFO - Closed all database connections
2026-08-04 23:00:27,316 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-04 23:00:27,316 - social_media_monitor.database.connection - INFO - Closed 0 database connections