โ† Logs

social_media_monitor_2026-08-17.log

2026-08-17 20:30:04,791 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term 'paperclip'
2026-08-17 20:30:05,963 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-17 20:30:05,963 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-08-17 20:30:05,963 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['multica'] within r/hermesagent+HermesAI
2026-08-17 20:30:06,172 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 0 entries for term 'multica'
2026-08-17 20:30:07,172 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-17 20:30:07,173 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-17 20:30:07,625 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-17 20:30:07,626 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-17 20:30:08,422 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-08-17 20:30:08,481 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-17 20:30:08,523 - GitHubScraper - INFO - Found 252 GitHub repositories for term: paperclip
2026-08-17 20:30:09,476 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-17 20:30:09,810 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-17 20:30:09,902 - GitHubScraper - INFO - Found 533 GitHub repositories for term: "Hermes Agent"
2026-08-17 20:30:10,026 - GitHubScraper - INFO - Added new GitHub repository: awesome-dsh-plugin
2026-08-17 20:30:10,703 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-08-17 20:30:10,972 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-17 20:30:11,064 - GitHubScraper - INFO - Found 61 GitHub repositories for term: multica
2026-08-17 20:30:11,196 - GitHubScraper - INFO - Total GitHub results found: 1
2026-08-17 20:30:13,921 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-17 20:30:14,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:14,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:14,421 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:14,426 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:14,771 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:14,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:14,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:14,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:15,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:15,230 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:15,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 20:30:15,483 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:15,569 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:15,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:15,691 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:15,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:15,982 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:16,019 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 20:30:16,091 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:16,130 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 20:30:16,380 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:16,415 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:16,505 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:16,569 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:16,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:16,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:16,853 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:16,970 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:17,269 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:17,295 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:17,297 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:17,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:17,651 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:17,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:17,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 20:30:17,957 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:18,082 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:18,138 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:18,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 20:30:18,425 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:18,518 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 20:30:18,609 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 20:30:18,717 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:18,886 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:18,938 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 20:30:18,948 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 20:30:19,040 - YouTubeIntelScraper - INFO - YouTube Intel found 42 candidates and 12 new videos
2026-08-17 20:30:19,137 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:19,292 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:19,339 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:19,548 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:19,551 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:19,618 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:19,734 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:19,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:19,931 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:19,934 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:20,157 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:20,314 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:20,400 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:20,455 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:20,726 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:20,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:20,770 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:20,913 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:21,126 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:21,163 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:21,172 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:21,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:21,484 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:21,515 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:21,604 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:21,663 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:21,793 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,045 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,082 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,219 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,417 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,464 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,485 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,585 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,722 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,908 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:22,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:23,099 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:23,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:23,301 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:23,341 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:23,443 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:23,616 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:23,642 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:23,671 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:23,797 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:23,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:24,035 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:24,117 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:24,174 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:24,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:24,398 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 20:30:24,459 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=282 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-17 20:30:24,460 - __main__ - INFO - Scraper reddit completed: 1 results
2026-08-17 20:30:24,460 - __main__ - INFO - Scraper github completed: 1 results
2026-08-17 20:30:24,460 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-17 20:30:24,460 - __main__ - INFO - Scraper youtube_intel completed: 12 results
2026-08-17 20:30:25,201 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-17 20:30:25.201363
2026-08-17 20:30:25,201 - __main__ - INFO - Email sent successfully
2026-08-17 20:30:25,202 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-17 20:30:25,202 - __main__ - INFO - Monitor complete. Found 14 total results: 1 new reddit results, 1 new github results, 12 new youtube intel results.
2026-08-17 20:30:25,202 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-17 20:30:25,202 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-17 20:30:25,300 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-17 20:30:25,300 - __main__ - INFO - Closed all database connections
2026-08-17 20:30:25,304 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-17 20:30:25,304 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-17 21:00:02,249 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-17.log
2026-08-17 21:00:02,250 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-17.log
2026-08-17 21:00:02,250 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-17.log
2026-08-17 21:00:02,250 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-17 21:00:02,275 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-17 21:00:02,276 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-17 21:00:02,278 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-17 21:00:02,279 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-17 21:00:02,302 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-17 21:00:02,302 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-17 21:00:02,305 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-17 21:00:02,306 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-17 21:00:02,306 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-17 21:00:02,308 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-17 21:00:02,309 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-17 21:00:02,309 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-17 21:00:02,311 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-17 21:00:02,316 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-17 21:00:02,316 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-17 21:00:02,319 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-17 21:00:02,319 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-17 21:00:02,319 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-17 21:00:02,321 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-17 21:00:02,322 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-17 21:00:02,322 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-17 21:00:02,322 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-17 21:00:02,413 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-17 21:00:02,417 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-17 21:00:02,418 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-17 21:00:02,419 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-17 21:00:02,525 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-17 21:00:02,527 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-17 21:00:06,316 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-17 21:00:06,411 - Yiddish24Scraper - INFO - Received response with 481498 characters
2026-08-17 21:00:06,414 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301095 chars)
2026-08-17 21:00:06,417 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-17 21:00:06,501 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-17 21:00:06,542 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-17 21:00:06,542 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-17 21:00:07,235 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles
2026-08-17 21:00:07,235 - Yiddish24Scraper - INFO - Page 1: 1/100 new items
2026-08-17 21:00:07,236 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination
2026-08-17 21:00:07,236 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1
2026-08-17 21:00:14,622 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-17 21:00:21,307 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-08-17 21:00:31,239 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-08-17 21:00:31,239 - IveltScraper - INFO - All forums scrape complete. Found 16 new posts.
2026-08-17 21:00:31,240 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-17 21:00:31,240 - __main__ - INFO - Scraper yiddish24 completed: 1 results
2026-08-17 21:00:31,240 - __main__ - INFO - Scraper ivelt completed: 16 results
2026-08-17 21:00:31,972 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-17 21:00:31.972231
2026-08-17 21:00:31,972 - __main__ - INFO - Email sent successfully
2026-08-17 21:00:31,972 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-17 21:00:31,972 - __main__ - INFO - Monitor complete. Found 17 total results: 1 new yiddish24 results, 16 new ivelt results.
2026-08-17 21:00:31,973 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-17 21:00:31,973 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-17 21:00:32,039 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-17 21:00:32,039 - __main__ - INFO - Closed all database connections
2026-08-17 21:00:32,041 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-17 21:00:32,041 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-17 22:00:01,957 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-17.log
2026-08-17 22:00:01,957 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-17.log
2026-08-17 22:00:01,957 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-17.log
2026-08-17 22:00:01,957 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-17 22:00:01,985 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-17 22:00:01,986 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-17 22:00:01,988 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-17 22:00:01,989 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-17 22:00:02,003 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-17 22:00:02,004 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-17 22:00:02,046 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-17 22:00:02,047 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-17 22:00:02,047 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-17 22:00:02,050 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-17 22:00:02,050 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-17 22:00:02,050 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-17 22:00:02,052 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-17 22:00:02,057 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-17 22:00:02,057 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-17 22:00:02,059 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-17 22:00:02,059 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-17 22:00:02,059 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-17 22:00:02,061 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-17 22:00:02,062 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-17 22:00:02,062 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-17 22:00:02,062 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-17 22:00:02,152 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-17 22:00:02,157 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-17 22:00:02,157 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-17 22:00:02,158 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-17 22:00:02,217 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-17 22:00:02,219 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-17 22:00:05,816 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-17 22:00:05,862 - Yiddish24Scraper - INFO - Received response with 481974 characters
2026-08-17 22:00:05,868 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (303249 chars)
2026-08-17 22:00:05,872 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-17 22:00:05,953 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-17 22:00:06,002 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-17 22:00:06,002 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-17 22:00:06,016 - Yiddish24Scraper - INFO - Term 'ืื™ื ื˜ืขืจืขืกืื ื˜ืก -' matched in DESCRIPTION: 'ืื™ื ื˜ืขืจืขืกืื ื˜ืก - ื˜ื•ื™ื–ืขื ื˜ืขืจ ื‘ื™ื ืขืŸ ื‘ื™ื™ื ืคืขื ืกื˜ืขืจ'
2026-08-17 22:00:06,016 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-17 22:00:06,516 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/____________________260_260817043253.mp3
2026-08-17 22:00:06,826 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_____________________260_260817043253.mp3 (25.4 MB)
2026-08-17 22:00:06,826 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-17 22:00:06,839 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_____________________260_260817043253.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-17 22:00:06,839 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_____________________260_260817043253_ืื™ื ื˜ืขืจืขืกืื ื˜ืก_-.mp3
2026-08-17 22:00:06,850 - Yiddish24Scraper - INFO - Term 'ื‘ื“ื—ืŸ' matched in TITLE: 'ืื™ื ื˜ืขืจื•ื•ื™ื•: "ื’ืจืืžืขืŸ ื‘ื™ื™ ื ื‘ืจื™ืช", ืื™ื™ื’ืขื ืืจื˜ื™ื’ืข ื’ืจืืžืขืŸ ื‘ื™ื™ ื ืคืจื™ื™ืœื™ื›ืขืจ ืžืขืžื“ ื”ื‘ืจื™ืช, ื ืฉืžื•ืขืก ืžื™ื˜ืŸ ื‘ื“ื—ืŸ, ื›ืฉื ืฉื ื›ื ืก ืœื‘ืจื™ืช ื›ืŸ ื™ื›ื ืก ืœืชื•ืจื” ื•ืœื—ื•ืคื”"'
2026-08-17 22:00:06,850 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: "ื’ืจืืžืขืŸ ื‘ื™ื™ ื ื‘ืจื™ืช", ืื™ื™ื’ืขื ืืจื˜ื™ื’ืข ื’ืจืืž
2026-08-17 22:00:07,516 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_44_1787001355.mp3
2026-08-17 22:00:07,628 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_44_1787001355.mp3 (662.4 KB)
2026-08-17 22:00:07,629 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-17 22:00:07,632 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_44_1787001355.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-17 22:00:07,632 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_44_1787001355_ื‘ื“ื—ืŸ.mp3
2026-08-17 22:00:08,447 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 100 total articles
2026-08-17 22:00:08,448 - Yiddish24Scraper - INFO - Page 1: 11/100 new items
2026-08-17 22:00:08,448 - Yiddish24Scraper - INFO - Low new item ratio (11.0%), stopping pagination
2026-08-17 22:00:08,448 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-08-17 22:00:14,339 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-17 22:00:17,560 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-08-17 22:00:43,663 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-08-17 22:00:43,663 - IveltScraper - INFO - All forums scrape complete. Found 18 new posts.
2026-08-17 22:00:43,664 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-17 22:00:43,664 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-08-17 22:00:43,664 - __main__ - INFO - Scraper ivelt completed: 18 results
2026-08-17 22:00:44,774 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-17 22:00:44.774256
2026-08-17 22:00:44,774 - __main__ - INFO - Email sent successfully
2026-08-17 22:00:44,775 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-17 22:00:44,775 - __main__ - INFO - Monitor complete. Found 29 total results: 11 new yiddish24 results, 18 new ivelt results.
2026-08-17 22:00:44,775 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-17 22:00:44,775 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-17 22:00:44,862 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-17 22:00:44,863 - __main__ - INFO - Closed all database connections
2026-08-17 22:00:44,865 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-17 22:00:44,865 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-17 22:30:01,749 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-17.log
2026-08-17 22:30:01,749 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-17.log
2026-08-17 22:30:01,749 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-17.log
2026-08-17 22:30:01,749 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-17 22:30:01,773 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-17 22:30:01,774 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-17 22:30:01,776 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-17 22:30:01,776 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-17 22:30:01,789 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-17 22:30:01,789 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-17 22:30:01,791 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-17 22:30:01,791 - __main__ - INFO - Reddit scraper initialized and enabled
2026-08-17 22:30:01,791 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-17 22:30:01,791 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-17 22:30:01,792 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-17 22:30:01,794 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-17 22:30:01,794 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-17 22:30:01,797 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-17 22:30:01,801 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-17 22:30:01,801 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-17 22:30:01,803 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-17 22:30:01,803 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-17 22:30:01,804 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-17 22:30:01,806 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-17 22:30:01,806 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-17 22:30:01,806 - __main__ - INFO - Running 4 scrapers concurrently...
2026-08-17 22:30:01,806 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-17 22:30:01,806 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['"Hermes Agent"']
2026-08-17 22:30:02,677 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term '"Hermes Agent"'
2026-08-17 22:30:02,687 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: โŸณ Mon, 17 Aug 2026 21:16:47 GMT: 7 apps added, 85 updated at f-droid.o
2026-08-17 22:30:02,701 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Need tips for optimization on Turing AI Server
2026-08-17 22:30:03,859 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 2
2026-08-17 22:30:03,860 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-08-17 22:30:03,860 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['paperclip'] within r/PaperClip_AI+PaperclipAI
2026-08-17 22:30:04,516 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term 'paperclip'
2026-08-17 22:30:05,682 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-17 22:30:05,683 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-08-17 22:30:05,683 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['multica'] within r/hermesagent+HermesAI
2026-08-17 22:30:05,892 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 0 entries for term 'multica'
2026-08-17 22:30:06,893 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-17 22:30:06,893 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-17 22:30:07,339 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-17 22:30:07,340 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-17 22:30:08,033 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-17 22:30:08,050 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-08-17 22:30:08,111 - GitHubScraper - INFO - Found 253 GitHub repositories for term: paperclip
2026-08-17 22:30:09,025 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-17 22:30:09,073 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-17 22:30:09,118 - GitHubScraper - INFO - Found 533 GitHub repositories for term: "Hermes Agent"
2026-08-17 22:30:10,034 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-17 22:30:10,037 - GitHubScraper - INFO - Found 61 GitHub repositories for term: multica
2026-08-17 22:30:10,163 - GitHubScraper - INFO - Total GitHub results found: 0
2026-08-17 22:30:10,210 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-08-17 22:30:12,516 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-17 22:30:12,910 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:12,970 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:13,004 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:13,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:13,319 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:13,326 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:13,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:13,415 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:13,676 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:13,709 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:13,801 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 22:30:14,021 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:14,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:14,116 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:14,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:14,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:14,471 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:14,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:14,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:14,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 22:30:14,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:15,038 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:15,048 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:15,124 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:15,300 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:15,387 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:15,491 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:15,574 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:15,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:15,862 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:15,907 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:16,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:16,451 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:16,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:16,503 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:16,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 22:30:16,872 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:16,874 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:17,014 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 22:30:17,040 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 22:30:17,144 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:17,440 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:17,448 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 22:30:17,584 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 22:30:17,637 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 22:30:17,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:17,845 - YouTubeIntelScraper - INFO - YouTube Intel found 42 candidates and 11 new videos
2026-08-17 22:30:17,850 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:17,970 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:18,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:18,094 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:18,170 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:18,260 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:18,451 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:18,505 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:18,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:18,563 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:18,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:18,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,004 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,342 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,445 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,511 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,935 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:19,949 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:20,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:20,295 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:20,303 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:20,332 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:20,613 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:20,676 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:20,678 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:20,734 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:20,942 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,041 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,047 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,090 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,465 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-17 22:30:21,551 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,694 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,741 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,812 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:21,835 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,120 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,151 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,202 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,479 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,487 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,546 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,574 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,828 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-17 22:30:22,891 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=282 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-17 22:30:22,892 - __main__ - INFO - Scraper reddit completed: 2 results
2026-08-17 22:30:22,892 - __main__ - INFO - Scraper github completed: 0 results
2026-08-17 22:30:22,892 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-17 22:30:22,892 - __main__ - INFO - Scraper youtube_intel completed: 11 results
2026-08-17 22:30:23,675 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-17 22:30:23.675696
2026-08-17 22:30:23,675 - __main__ - INFO - Email sent successfully
2026-08-17 22:30:23,676 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-17 22:30:23,676 - __main__ - INFO - Monitor complete. Found 13 total results: 2 new reddit results, 11 new youtube intel results.
2026-08-17 22:30:23,676 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-17 22:30:23,676 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-17 22:30:23,768 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-17 22:30:23,768 - __main__ - INFO - Closed all database connections
2026-08-17 22:30:23,772 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-17 22:30:23,773 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-17 23:00:01,683 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-17.log
2026-08-17 23:00:01,683 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-17.log
2026-08-17 23:00:01,684 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-17.log
2026-08-17 23:00:01,684 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-17 23:00:01,709 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-17 23:00:01,710 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-17 23:00:01,712 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-17 23:00:01,712 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-17 23:00:01,727 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-17 23:00:01,727 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-17 23:00:01,729 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-17 23:00:01,730 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-17 23:00:01,730 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-17 23:00:01,732 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-17 23:00:01,732 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-17 23:00:01,732 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-17 23:00:01,735 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-17 23:00:01,739 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-17 23:00:01,739 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-17 23:00:01,741 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-17 23:00:01,741 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-17 23:00:01,741 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-17 23:00:01,743 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-17 23:00:01,744 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-17 23:00:01,744 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-17 23:00:01,744 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-17 23:00:01,831 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-17 23:00:01,835 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-17 23:00:01,835 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-17 23:00:01,836 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-17 23:00:01,965 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-17 23:00:01,968 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-17 23:00:05,986 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-17 23:00:06,208 - Yiddish24Scraper - INFO - Received response with 479032 characters
2026-08-17 23:00:06,211 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301608 chars)
2026-08-17 23:00:06,214 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-17 23:00:06,310 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-17 23:00:06,363 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-17 23:00:06,363 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-17 23:00:07,251 - Yiddish24Scraper - INFO - Page 1 summary: 9 new out of 100 total articles
2026-08-17 23:00:07,251 - Yiddish24Scraper - INFO - Page 1: 9/100 new items
2026-08-17 23:00:07,251 - Yiddish24Scraper - INFO - Low new item ratio (9.0%), stopping pagination
2026-08-17 23:00:07,251 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 9
2026-08-17 23:00:13,921 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-17 23:00:21,589 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.
2026-08-17 23:00:21,589 - IveltScraper - INFO - All forums scrape complete. Found 13 new posts.
2026-08-17 23:00:21,589 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-17 23:00:21,589 - __main__ - INFO - Scraper yiddish24 completed: 9 results
2026-08-17 23:00:21,589 - __main__ - INFO - Scraper ivelt completed: 13 results
2026-08-17 23:00:22,302 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-17 23:00:22.302344
2026-08-17 23:00:22,302 - __main__ - INFO - Email sent successfully
2026-08-17 23:00:22,302 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-17 23:00:22,303 - __main__ - INFO - Monitor complete. Found 22 total results: 9 new yiddish24 results, 13 new ivelt results.
2026-08-17 23:00:22,303 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-17 23:00:22,303 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-17 23:00:22,401 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-17 23:00:22,401 - __main__ - INFO - Closed all database connections
2026-08-17 23:00:22,403 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-17 23:00:22,403 - social_media_monitor.database.connection - INFO - Closed 0 database connections