← Logs

social_media_monitor_2026-08-05.log

2026-08-05 20:30:02,432 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-05 20:30:02,432 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-05 20:30:02,434 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-05 20:30:02,434 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-05 20:30:02,435 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-05 20:30:02,437 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-05 20:30:02,437 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-08-05 20:30:02,437 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-05 20:30:02,437 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-08-05 20:30:02,624 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for https://www.youtube.com/feed/subscriptions: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,626 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:OmniRoute: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,627 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Buzz: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,629 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Paperclip: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,629 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Multica: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,630 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:mobile app development: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,630 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:React Native: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,631 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Flutter mobile development: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,631 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:iOS development: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,632 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Android development: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,632 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Swift programming: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,633 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Kotlin development: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 20:30:02,633 - YouTubeIntelScraper - INFO - YouTube Intel found 0 candidates and 0 new videos

2026-08-05 20:30:02,953 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-08-05 20:30:02,954 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-08-05 20:30:03,595 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-05 20:30:03,622 - GitHubScraper - INFO - Found 247 GitHub repositories for term: paperclip

2026-08-05 20:30:03,878 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:03,879 - GitHubFeedScraper - INFO - GitHub account feed page 1 unchanged (ETag)

2026-08-05 20:30:04,681 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-05 20:30:04,684 - GitHubScraper - INFO - Found 498 GitHub repositories for term: "Hermes Agent"

2026-08-05 20:30:05,738 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-05 20:30:05,742 - GitHubScraper - INFO - Found 57 GitHub repositories for term: multica

2026-08-05 20:30:05,889 - GitHubScraper - INFO - Total GitHub results found: 0

2026-08-05 20:30:07,686 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-08-05 20:30:08,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:08,187 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:08,232 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:08,246 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:08,603 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:08,644 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:08,744 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:08,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:09,084 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:09,097 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:09,152 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:09,453 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:09,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:09,528 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:09,584 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:09,782 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:09,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:10,084 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:10,112 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:10,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:10,394 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:10,443 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:10,534 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:10,646 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:10,729 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:10,758 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:10,941 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:11,182 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:11,260 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:11,373 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:11,385 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:11,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/abdsaleh306090/medsynth/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:11,641 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:11,806 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:11,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:12,106 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:12,130 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:12,228 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:12,334 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:12,492 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:12,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:12,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/safimomin/Kofax-PaperPort-Portable-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:12,773 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:12,852 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:12,978 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:13,210 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:13,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:13,228 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:13,362 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:13,661 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:13,662 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:13,684 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:13,705 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:13,993 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:14,021 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:14,095 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:14,259 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:14,422 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:14,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:14,497 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:14,677 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:15,047 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:15,062 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:15,079 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:15,102 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:15,416 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:15,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:15,627 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:15,724 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/gemaraproj/gemara-publish-action/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:15,791 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:15,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:16,049 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:16,105 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:16,189 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:16,212 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:16,508 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 20:30:16,516 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:16,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:16,685 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:16,844 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:16,920 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:16,957 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:17,106 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:17,254 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:17,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:17,478 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:17,489 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:17,600 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:17,763 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:17,904 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:17,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:17,988 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:18,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:18,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:18,245 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:18,389 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:18,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:18,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:18,648 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:18,921 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 20:30:19,044 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=0 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-08-05 20:30:19,046 - __main__ - INFO - Scraper github completed: 0 results

2026-08-05 20:30:19,046 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-08-05 20:30:19,047 - __main__ - INFO - Scraper youtube_intel completed: 0 results

2026-08-05 20:30:19,047 - __main__ - INFO - No new results found across all enabled sources

2026-08-05 20:30:19,047 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-05 20:30:19,047 - __main__ - INFO - Monitor complete. No new results found across all sources.

2026-08-05 20:30:19,047 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-05 20:30:19,047 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-05 20:30:19,062 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-05 20:30:19,062 - __main__ - INFO - Closed all database connections

2026-08-05 20:30:19,064 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-05 20:30:19,064 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-05 21:00:02,232 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-05.log

2026-08-05 21:00:02,232 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-05.log

2026-08-05 21:00:02,232 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-05.log

2026-08-05 21:00:02,232 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-05 21:00:02,266 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-05 21:00:02,266 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-05 21:00:02,268 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-05 21:00:02,269 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-05 21:00:02,284 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-05 21:00:02,284 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-05 21:00:02,329 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-08-05 21:00:02,330 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-05 21:00:02,330 - __main__ - INFO - RSS scraper initialized and enabled

2026-08-05 21:00:02,333 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-05 21:00:02,333 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-05 21:00:02,333 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-08-05 21:00:02,336 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-05 21:00:02,340 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-05 21:00:02,341 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-05 21:00:02,343 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-05 21:00:02,343 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-05 21:00:02,343 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-05 21:00:02,345 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-05 21:00:02,345 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-08-05 21:00:02,345 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-05 21:00:02,346 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-08-05 21:00:02,452 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-08-05 21:00:02,456 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters

2026-08-05 21:00:02,456 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-08-05 21:00:02,457 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-08-05 21:00:02,605 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined

2026-08-05 21:00:02,607 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-08-05 21:00:08,792 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-08-05 21:00:09,019 - Yiddish24Scraper - INFO - Received response with 494232 characters

2026-08-05 21:00:09,024 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (308013 chars)

2026-08-05 21:00:09,028 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-08-05 21:00:09,113 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-08-05 21:00:09,154 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-08-05 21:00:09,154 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-08-05 21:00:09,164 - Yiddish24Scraper - INFO - Term 'אברהם האלפרין' matched in DESCRIPTION: 'געדאנקן און אבזערוואציעס - ר' זלמן לייב פרענקל און ר' אברהם האלפרין'

2026-08-05 21:00:09,164 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-08-05 21:00:09,664 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/LEIBY_AVRUMY_260_260805040327.mp3

2026-08-05 21:00:10,863 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_LEIBY_AVRUMY_260_260805040327.mp3 (8.5 MB)

2026-08-05 21:00:10,864 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-08-05 21:00:10,880 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_LEIBY_AVRUMY_260_260805040327.mp3: title, artist, album, comment, source_url, genre, publisher

2026-08-05 21:00:10,880 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_LEIBY_AVRUMY_260_260805040327_אברהם_האלפרין.mp3

2026-08-05 21:00:12,185 - Yiddish24Scraper - INFO - Page 1 summary: 7 new out of 100 total articles

2026-08-05 21:00:12,185 - Yiddish24Scraper - INFO - Page 1: 7/100 new items

2026-08-05 21:00:12,185 - Yiddish24Scraper - INFO - Low new item ratio (7.0%), stopping pagination

2026-08-05 21:00:12,186 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 7

2026-08-05 21:00:14,561 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-08-05 21:00:22,938 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-08-05 21:00:26,099 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-08-05 21:01:43,146 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.

2026-08-05 21:01:43,146 - IveltScraper - INFO - All forums scrape complete. Found 42 new posts.

2026-08-05 21:01:43,146 - __main__ - INFO - Scraper rss completed: 0 results

2026-08-05 21:01:43,147 - __main__ - INFO - Scraper yiddish24 completed: 7 results

2026-08-05 21:01:43,147 - __main__ - INFO - Scraper ivelt completed: 42 results

2026-08-05 21:01:44,538 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-05 21:01:44.538745

2026-08-05 21:01:44,539 - __main__ - INFO - Email sent successfully

2026-08-05 21:01:44,539 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-05 21:01:44,539 - __main__ - INFO - Monitor complete. Found 49 total results: 7 new yiddish24 results, 42 new ivelt results.

2026-08-05 21:01:44,539 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-05 21:01:44,539 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-05 21:01:44,608 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-05 21:01:44,608 - __main__ - INFO - Closed all database connections

2026-08-05 21:01:44,610 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-05 21:01:44,611 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-05 22:00:02,563 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-05.log

2026-08-05 22:00:02,563 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-05.log

2026-08-05 22:00:02,563 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-05.log

2026-08-05 22:00:02,563 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-05 22:00:02,596 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-05 22:00:02,597 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-05 22:00:02,599 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-05 22:00:02,599 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-05 22:00:02,614 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-05 22:00:02,614 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-05 22:00:02,658 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-08-05 22:00:02,659 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-05 22:00:02,659 - __main__ - INFO - RSS scraper initialized and enabled

2026-08-05 22:00:02,663 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-05 22:00:02,663 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-05 22:00:02,663 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-08-05 22:00:02,665 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-05 22:00:02,670 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-05 22:00:02,670 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-05 22:00:02,672 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-05 22:00:02,672 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-05 22:00:02,672 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-05 22:00:02,674 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-05 22:00:02,674 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-08-05 22:00:02,674 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-05 22:00:02,674 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-08-05 22:00:02,770 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-08-05 22:00:02,777 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters

2026-08-05 22:00:02,778 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-08-05 22:00:02,779 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-08-05 22:00:02,876 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined

2026-08-05 22:00:02,878 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-08-05 22:00:06,522 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-08-05 22:00:06,737 - Yiddish24Scraper - INFO - Received response with 490519 characters

2026-08-05 22:00:06,740 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (307243 chars)

2026-08-05 22:00:06,743 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-08-05 22:00:06,830 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-08-05 22:00:06,871 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-08-05 22:00:06,871 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-08-05 22:00:07,784 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles

2026-08-05 22:00:07,784 - Yiddish24Scraper - INFO - Page 1: 6/100 new items

2026-08-05 22:00:07,784 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination

2026-08-05 22:00:07,785 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-08-05 22:00:14,757 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-08-05 22:00:29,782 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.

2026-08-05 22:00:29,782 - IveltScraper - INFO - All forums scrape complete. Found 13 new posts.

2026-08-05 22:00:29,783 - __main__ - INFO - Scraper rss completed: 0 results

2026-08-05 22:00:29,783 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-08-05 22:00:29,783 - __main__ - INFO - Scraper ivelt completed: 13 results

2026-08-05 22:00:30,776 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-05 22:00:30.776561

2026-08-05 22:00:30,776 - __main__ - INFO - Email sent successfully

2026-08-05 22:00:30,777 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-05 22:00:30,777 - __main__ - INFO - Monitor complete. Found 19 total results: 6 new yiddish24 results, 13 new ivelt results.

2026-08-05 22:00:30,777 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-05 22:00:30,777 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-05 22:00:30,826 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-05 22:00:30,826 - __main__ - INFO - Closed all database connections

2026-08-05 22:00:30,828 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-05 22:00:30,828 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-05 22:30:02,122 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-05.log

2026-08-05 22:30:02,122 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-05.log

2026-08-05 22:30:02,122 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-05.log

2026-08-05 22:30:02,122 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-05 22:30:02,154 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-05 22:30:02,154 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-05 22:30:02,156 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-05 22:30:02,157 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-05 22:30:02,170 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-05 22:30:02,170 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-05 22:30:02,173 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-08-05 22:30:02,173 - __main__ - INFO - GitHub scraper initialized and enabled

2026-08-05 22:30:02,173 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-08-05 22:30:02,173 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-05 22:30:02,176 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-05 22:30:02,176 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-05 22:30:02,179 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-05 22:30:02,183 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-05 22:30:02,183 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-05 22:30:02,185 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-05 22:30:02,185 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-05 22:30:02,185 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-05 22:30:02,187 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-05 22:30:02,188 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-08-05 22:30:02,188 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-05 22:30:02,188 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-08-05 22:30:02,286 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for https://www.youtube.com/feed/subscriptions: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,287 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:OmniRoute: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,288 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Buzz: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,289 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Paperclip: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,290 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Multica: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,291 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:mobile app development: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,291 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:React Native: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,292 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Flutter mobile development: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,292 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:iOS development: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,293 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Android development: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,293 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Swift programming: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,294 - YouTubeIntelScraper - ERROR - YouTube Intel command failed for ytsearch5:Kotlin development: [Errno 2] No such file or directory: 'yt-dlp'

2026-08-05 22:30:02,294 - YouTubeIntelScraper - INFO - YouTube Intel found 0 candidates and 0 new videos

2026-08-05 22:30:02,596 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-08-05 22:30:02,597 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-08-05 22:30:03,219 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-05 22:30:03,245 - GitHubScraper - INFO - Found 247 GitHub repositories for term: paperclip

2026-08-05 22:30:03,560 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:03,560 - GitHubFeedScraper - INFO - GitHub account feed page 1 unchanged (ETag)

2026-08-05 22:30:04,355 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-05 22:30:04,360 - GitHubScraper - INFO - Found 498 GitHub repositories for term: "Hermes Agent"

2026-08-05 22:30:05,390 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-05 22:30:05,489 - GitHubScraper - INFO - Found 57 GitHub repositories for term: multica

2026-08-05 22:30:05,634 - GitHubScraper - INFO - Total GitHub results found: 0

2026-08-05 22:30:06,859 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-08-05 22:30:07,252 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:07,259 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:07,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:07,442 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:07,624 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:07,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:07,798 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:07,838 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:07,993 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:08,165 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:08,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:08,391 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:08,430 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:08,570 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:08,640 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:08,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:08,815 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:09,135 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:09,137 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:09,194 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:09,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:09,562 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:09,564 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:09,569 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:09,723 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:09,946 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:09,960 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:10,024 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:10,188 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:10,406 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:10,469 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/abdsaleh306090/medsynth/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:10,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:10,600 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:10,943 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:10,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:11,069 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:11,268 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:11,303 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:11,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:11,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:11,795 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/safimomin/Kofax-PaperPort-Portable-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:11,836 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:11,838 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:11,842 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:12,143 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:12,206 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:12,325 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:12,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:12,491 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:12,552 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:12,656 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:12,808 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:12,872 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:12,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:13,068 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:13,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:13,444 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:13,492 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:13,495 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:13,628 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:13,847 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:14,076 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:14,135 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:14,136 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:14,250 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:14,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:14,549 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:14,638 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:14,831 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/gemaraproj/gemara-publish-action/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:14,896 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:14,967 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:15,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:15,205 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:15,353 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:15,359 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:15,412 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:15,578 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:15,776 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:15,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:16,061 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:16,097 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:16,143 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:16,169 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:16,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:16,477 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:16,544 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:16,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:16,840 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:16,874 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:16,965 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:17,189 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:17,200 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-05 22:30:17,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:17,397 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:17,566 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:17,603 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:17,692 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:17,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:17,933 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:18,120 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-05 22:30:18,213 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=0 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1

2026-08-05 22:30:18,214 - __main__ - INFO - Scraper github completed: 0 results

2026-08-05 22:30:18,214 - __main__ - INFO - Scraper github_feed completed: 1 results

2026-08-05 22:30:18,214 - __main__ - INFO - Scraper youtube_intel completed: 0 results

2026-08-05 22:30:18,848 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-05 22:30:18.848321

2026-08-05 22:30:18,848 - __main__ - INFO - Email sent successfully

2026-08-05 22:30:18,861 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed

2026-08-05 22:30:18,861 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-05 22:30:18,861 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new github feed results.

2026-08-05 22:30:18,861 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-05 22:30:18,861 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-05 22:30:18,883 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-05 22:30:18,883 - __main__ - INFO - Closed all database connections

2026-08-05 22:30:18,886 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-05 22:30:18,886 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-05 23:00:02,083 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-05.log

2026-08-05 23:00:02,083 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-05.log

2026-08-05 23:00:02,083 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-05.log

2026-08-05 23:00:02,083 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-05 23:00:02,116 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-05 23:00:02,116 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-05 23:00:02,119 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-05 23:00:02,120 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-05 23:00:02,134 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-05 23:00:02,134 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-05 23:00:02,136 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-08-05 23:00:02,137 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-05 23:00:02,137 - __main__ - INFO - RSS scraper initialized and enabled

2026-08-05 23:00:02,140 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-05 23:00:02,140 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-05 23:00:02,140 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-08-05 23:00:02,143 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-05 23:00:02,150 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-05 23:00:02,150 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-05 23:00:02,152 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-05 23:00:02,152 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-05 23:00:02,153 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-05 23:00:02,155 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-05 23:00:02,155 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-08-05 23:00:02,155 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-05 23:00:02,155 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-08-05 23:00:02,249 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-08-05 23:00:02,253 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters

2026-08-05 23:00:02,253 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-08-05 23:00:02,254 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-08-05 23:00:02,346 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined

2026-08-05 23:00:02,347 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-08-05 23:00:06,975 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-08-05 23:00:07,186 - Yiddish24Scraper - INFO - Received response with 491814 characters

2026-08-05 23:00:07,190 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (305426 chars)

2026-08-05 23:00:07,194 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-08-05 23:00:07,281 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-08-05 23:00:07,327 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-08-05 23:00:07,327 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-08-05 23:00:08,175 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 100 total articles

2026-08-05 23:00:08,175 - Yiddish24Scraper - INFO - Page 1: 4/100 new items

2026-08-05 23:00:08,175 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination

2026-08-05 23:00:08,176 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4

2026-08-05 23:00:14,283 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-08-05 23:00:24,194 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-08-05 23:00:46,032 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-08-05 23:00:46,032 - IveltScraper - INFO - All forums scrape complete. Found 18 new posts.

2026-08-05 23:00:46,032 - __main__ - INFO - Scraper rss completed: 0 results

2026-08-05 23:00:46,032 - __main__ - INFO - Scraper yiddish24 completed: 4 results

2026-08-05 23:00:46,033 - __main__ - INFO - Scraper ivelt completed: 18 results

2026-08-05 23:00:46,796 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-05 23:00:46.796656

2026-08-05 23:00:46,797 - __main__ - INFO - Email sent successfully

2026-08-05 23:00:46,797 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-05 23:00:46,797 - __main__ - INFO - Monitor complete. Found 22 total results: 4 new yiddish24 results, 18 new ivelt results.

2026-08-05 23:00:46,797 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-05 23:00:46,797 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-05 23:00:46,878 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-05 23:00:46,878 - __main__ - INFO - Closed all database connections

2026-08-05 23:00:46,880 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-05 23:00:46,881 - social_media_monitor.database.connection - INFO - Closed 0 database connections