← Logs

social_media_monitor_2026-06-04.log

2026-06-04 22:01:25,800 - KolHalashonScraper - INFO - Found current parsha: Behaalotcha (בהעלותך)

2026-06-04 22:01:25,800 - KolHalashonScraper - INFO - Using parsha URL template (id=1): https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?u...

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Parsha raw URL template: https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?urlFilters=3:3%7C{speakersfilter}

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Speaker IDs for URL id=1: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Parsha speaker filter string: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Parsha encoded speaker filter: 2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Parsha processed URL: https://www2.kolhalashon.com/regularSite/searchResults/1/36/Behaalotcha?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Current parsha: Behaalotcha (בהעלותך)

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Processing parsha URL (id=1)

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Processing 3 total URLs (1 parsha + 2 search)

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Replacing parsha placeholders with id=36, name=Behaalotcha, in_humash=3

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Found 1 scheduled daf(s) for today: {49: 23}

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Replaced daf placeholders: masechet_id=49, name=Meilah, daf_no=23

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Scraping all 3 URLs with unified method...

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Starting multi-URL browser scrape with 3 URLs, max 10 pages per URL (download_inline=True)

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Running browser in non-headless mode (Cloudflare bypass)

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Browser download directory set to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:01:25,801 - KolHalashonScraper - INFO - Using undetected-chromedriver for Cloudflare bypass (attempt 1/3)

2026-06-04 22:01:26,027 - undetected_chromedriver.patcher - INFO - patching driver executable /home/openclaw/.local/share/undetected_chromedriver/undetected_chromedriver

2026-06-04 22:01:26,632 - KolHalashonScraper - INFO - Browser created for multi-URL scrape

2026-06-04 22:01:26,716 - KolHalashonScraper - INFO - Configured download behavior via Browser.setDownloadBehavior CDP for /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:01:26,720 - KolHalashonScraper - INFO - Configured download behavior via Page.setDownloadBehavior CDP for /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:01:26,720 - KolHalashonScraper - INFO - STEP 1 login: opening base URL https://www2.kolhalashon.com before processing target URLs

2026-06-04 22:01:27,929 - KolHalashonScraper - INFO - Processing URL (id=1): https://www2.kolhalashon.com/regularSite/searchResults/1/36/Behaalotcha?urlFilters=3:3%7C{speakersfilter}

2026-06-04 22:01:27,930 - KolHalashonScraper - INFO - Replaced speakersfilter placeholder with 10 speaker filter(s)

2026-06-04 22:01:27,930 - KolHalashonScraper - INFO - Final processed URL: https://www2.kolhalashon.com/regularSite/searchResults/1/36/Behaalotcha?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031

2026-06-04 22:01:27,930 - KolHalashonScraper - INFO - STEP 2 visit processed URL: https://www2.kolhalashon.com/regularSite/searchResults/1/36/Behaalotcha?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031

2026-06-04 22:01:28,785 - KolHalashonScraper - INFO - Login required – attempting to log in

2026-06-04 22:01:28,817 - KolHalashonScraper - INFO - [DELAY] Waiting 1.0s after login button click

2026-06-04 22:01:31,873 - KolHalashonScraper - INFO - Submitted login form with stored credentials

2026-06-04 22:01:33,906 - KolHalashonScraper - INFO - Login confirmed

2026-06-04 22:01:37,952 - KolHalashonScraper - INFO - Page loaded with 49 shiur containers after 0s

2026-06-04 22:01:37,953 - KolHalashonScraper - INFO - [DELAY] Waiting 70.0s for page content to stabilize (shiur_found_wait)

2026-06-04 22:02:53,991 - KolHalashonScraper - INFO - Processing page 1 of URL (pagination shows: page 1 of 1, has_next=False)

2026-06-04 22:02:53,991 - KolHalashonScraper - INFO - [DELAY] Waiting 6.0s for DOM extraction (dom_extraction_wait)

2026-06-04 22:03:00,007 - KolHalashonScraper - INFO - Extracted 16 shiurim from DOM

2026-06-04 22:03:00,007 - KolHalashonScraper - INFO - Page 1: Browser extracted 16 shiurim

2026-06-04 22:03:00,009 - KolHalashonScraper - INFO - Starting inline downloads for page 1 (reusing current page)

2026-06-04 22:03:00,010 - KolHalashonScraper - WARNING - hdate returned 'בהעלתך' with no match in parsha_list (alternate Hebrew spelling?); checking fallback table for 2026-06-06

2026-06-04 22:03:00,010 - KolHalashonScraper - INFO - Resolved parsha via fallback (spelling variant): Behaalotcha (בהעלותך)

2026-06-04 22:03:00,011 - KolHalashonScraper - INFO - Found current parsha: Behaalotcha (בהעלותך)

2026-06-04 22:03:00,011 - KolHalashonScraper - INFO - Using parsha URL template (id=1): https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?u...

2026-06-04 22:03:00,011 - KolHalashonScraper - INFO - Parsha raw URL template: https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?urlFilters=3:3%7C{speakersfilter}

2026-06-04 22:03:00,011 - KolHalashonScraper - INFO - Speaker IDs for URL id=1: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-06-04 22:03:00,011 - KolHalashonScraper - INFO - Parsha speaker filter string: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-06-04 22:03:00,011 - KolHalashonScraper - INFO - Parsha encoded speaker filter: 2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-06-04 22:03:00,011 - KolHalashonScraper - INFO - Parsha processed URL: https://www2.kolhalashon.com/regularSite/searchResults/1/36/Behaalotcha?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-06-04 22:03:00,011 - KolHalashonScraper - INFO - Download directory: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:03:00,012 - KolHalashonScraper - INFO - Using 4 provided shiur(s) for download (page-derived, in-memory)

2026-06-04 22:03:00,012 - KolHalashonScraper - INFO - Starting download of 4 shiurim (one_per_speaker=True)

2026-06-04 22:03:00,016 - KolHalashonScraper - INFO - Configured download behavior via Browser.setDownloadBehavior CDP for /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:03:00,019 - KolHalashonScraper - INFO - Configured download behavior via Page.setDownloadBehavior CDP for /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:03:00,020 - KolHalashonScraper - INFO - Reusing current page for downloads (no navigation)

2026-06-04 22:03:06,099 - KolHalashonScraper - INFO - Processing page 1 (pagination shows: page 1 of 1, has_next=False)

2026-06-04 22:03:06,111 - KolHalashonScraper - INFO - Page 1 has 16 shiur items

2026-06-04 22:03:06,111 - KolHalashonScraper - INFO - [p1:0] Attempting download: 39:14 Harav Mordechai Yehuda Friedman ענינים על פרשת השבוע פ by Unknown (ID: 42564151)

2026-06-04 22:03:10,024 - KolHalashonScraper - INFO - Extracted media URL for shiur 42564151: https://www.kolhalashon.com/api/files/GetMp3FileToPlay/42564151

2026-06-04 22:03:10,392 - KolHalashonScraper - INFO - Starting HTTP download: https://www.kolhalashon.com/api/files/GetMp3FileToPlay/42564151

2026-06-04 22:03:11,392 - KolHalashonScraper - INFO - Download complete: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/42564151_temp.mp3 (9465005 bytes)

2026-06-04 22:03:11,393 - KolHalashonScraper - INFO - Renamed: 42564151_temp.mp3 -> KH_ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha - Harav Mordechai Yehuda Friedman (42564151).mp3

2026-06-04 22:03:11,398 - KolHalashonScraper - INFO - Tagged: KH_ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha - Harav Mordechai Yehuda Friedman (42564151).mp3 (Harav Mordechai Yehuda Friedman — ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha)

2026-06-04 22:03:11,398 - KolHalashonScraper - INFO - [p1:0] Direct HTTP download completed: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/KH_ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha - Harav Mordechai Yehuda Friedman (42564151).mp3

2026-06-04 22:03:11,399 - KolHalashonScraper - INFO - [p1:0] Downloaded: 39:14 Harav Mordechai Yehuda Friedman ענינים על פרשת השבוע פ by Unknown

2026-06-04 22:03:12,399 - KolHalashonScraper - INFO - [p1:1] Attempting download: 43:54 Harav Yitzchak Aharon Goldhirsh פרשת בהעלותך תשפו, Par by Unknown (ID: 42561410)

2026-06-04 22:03:15,835 - KolHalashonScraper - INFO - Extracted media URL for shiur 42561410: https://www.kolhalashon.com/imgs/VideoThumbNails/42561/42561410.jpg

2026-06-04 22:03:16,091 - KolHalashonScraper - INFO - Starting HTTP download: https://www.kolhalashon.com/imgs/VideoThumbNails/42561/42561410.jpg

2026-06-04 22:03:16,181 - KolHalashonScraper - INFO - Download complete: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/42561410_temp.mp3 (11996 bytes)

2026-06-04 22:03:16,182 - KolHalashonScraper - INFO - Renamed: 42561410_temp.mp3 -> KH_פרשת בהעלותך תשפו, Parashat Beha'aloscha - Harav Yitzchak Aharon Goldhirsh (42561410).mp3

2026-06-04 22:03:16,183 - KolHalashonScraper - INFO - Tagged: KH_פרשת בהעלותך תשפו, Parashat Beha'aloscha - Harav Yitzchak Aharon Goldhirsh (42561410).mp3 (Harav Yitzchak Aharon Goldhirsh — פרשת בהעלותך תשפו, Parashat Beha'aloscha)

2026-06-04 22:03:16,183 - KolHalashonScraper - INFO - [p1:1] Direct HTTP download completed: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/KH_פרשת בהעלותך תשפו, Parashat Beha'aloscha - Harav Yitzchak Aharon Goldhirsh (42561410).mp3

2026-06-04 22:03:16,183 - KolHalashonScraper - INFO - [p1:1] Downloaded: 43:54 Harav Yitzchak Aharon Goldhirsh פרשת בהעלותך תשפו, Par by Unknown

2026-06-04 22:03:17,183 - KolHalashonScraper - INFO - [p1:2] Attempting download: 12:49 Harav Elazar Nissan Rubin Parashat Beha'aloscha, Sefer by Unknown (ID: 41815361)

2026-06-04 22:03:20,625 - KolHalashonScraper - INFO - Extracted media URL for shiur 41815361: https://www.kolhalashon.com/api/files/GetMp3FileToPlay/41815361

2026-06-04 22:03:20,861 - KolHalashonScraper - INFO - Starting HTTP download: https://www.kolhalashon.com/api/files/GetMp3FileToPlay/41815361

2026-06-04 22:03:21,682 - KolHalashonScraper - INFO - Download complete: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/41815361_temp.mp3 (3125103 bytes)

2026-06-04 22:03:21,683 - KolHalashonScraper - INFO - Renamed: 41815361_temp.mp3 -> KH_Parashat Beha'aloscha, Sefer Ohr Hachaim, Part 2 - Harav Elazar Nissan Rubin (41815361).mp3

2026-06-04 22:03:21,686 - KolHalashonScraper - INFO - Tagged: KH_Parashat Beha'aloscha, Sefer Ohr Hachaim, Part 2 - Harav Elazar Nissan Rubin (41815361).mp3 (Harav Elazar Nissan Rubin — Parashat Beha'aloscha, Sefer Ohr Hachaim, Part 2)

2026-06-04 22:03:21,686 - KolHalashonScraper - INFO - [p1:2] Direct HTTP download completed: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/KH_Parashat Beha'aloscha, Sefer Ohr Hachaim, Part 2 - Harav Elazar Nissan Rubin (41815361).mp3

2026-06-04 22:03:21,686 - KolHalashonScraper - INFO - [p1:2] Downloaded: 12:49 Harav Elazar Nissan Rubin Parashat Beha'aloscha, Sefer by Unknown

2026-06-04 22:03:22,686 - KolHalashonScraper - INFO - [p1:3] Attempting download: 22:37 Harav Chaim Shlomo Miller Parashat Beha'aloscha Parsha by Unknown (ID: 41754339)

2026-06-04 22:03:26,102 - KolHalashonScraper - INFO - Extracted media URL for shiur 41754339: https://www.kolhalashon.com/api/files/GetMp3FileToPlay/41754339

2026-06-04 22:03:26,342 - KolHalashonScraper - INFO - Starting HTTP download: https://www.kolhalashon.com/api/files/GetMp3FileToPlay/41754339

2026-06-04 22:03:27,244 - KolHalashonScraper - INFO - Download complete: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/41754339_temp.mp3 (5463911 bytes)

2026-06-04 22:03:27,245 - KolHalashonScraper - INFO - Renamed: 41754339_temp.mp3 -> KH_Parashat Beha'aloscha - Harav Chaim Shlomo Miller (41754339).mp3

2026-06-04 22:03:27,249 - KolHalashonScraper - INFO - Tagged: KH_Parashat Beha'aloscha - Harav Chaim Shlomo Miller (41754339).mp3 (Harav Chaim Shlomo Miller — Parashat Beha'aloscha)

2026-06-04 22:03:27,249 - KolHalashonScraper - INFO - [p1:3] Direct HTTP download completed: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/KH_Parashat Beha'aloscha - Harav Chaim Shlomo Miller (41754339).mp3

2026-06-04 22:03:27,249 - KolHalashonScraper - INFO - [p1:3] Downloaded: 22:37 Harav Chaim Shlomo Miller Parashat Beha'aloscha Parsha by Unknown

2026-06-04 22:03:28,249 - KolHalashonScraper - INFO - [p1:4] Skip (not_requested_or_already_downloaded): 45:12 Harav Elazar Nissan Rubin Parashat Beha'aloscha, Part by Unknown (ID: 41754098)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:5] Skip (not_requested_or_already_downloaded): 52:43 Harav Elazar Nissan Rubin Parashat Beha'aloscha, Part by Unknown (ID: 41754099)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:6] Skip (not_requested_or_already_downloaded): 40:47 Harav Yitzchak Aharon Goldhirsh פרשת בהעלתך תשפ"ה, Par by Unknown (ID: 41753092)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:7] Skip (not_requested_or_already_downloaded): 56:55 Harav Elazar Nissan Rubin Parashat Beha'aloscha, Part by Unknown (ID: 41750926)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:8] Skip (not_requested_or_already_downloaded): 17:53 Harav Elazar Nissan Rubin Parashat Beha'aloscha, Sefer by Unknown (ID: 41749767)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:9] Skip (not_requested_or_already_downloaded): 19:55 Harav Yitzchak Aharon Goldhirsh יום ב , Parashat Beha' by Unknown (ID: 41797123)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:10] Skip (not_requested_or_already_downloaded): 20:06 Harav Yitzchak Aharon Goldhirsh יום א פרשת בהעלותך, Pa by Unknown (ID: 41795497)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:11] Skip (not_requested_or_already_downloaded): 41:01 Harav Mordechai Yehuda Friedman ענינים על פרשת השבוע פ by Unknown (ID: 35353554)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:12] Skip (not_requested_or_already_downloaded): 40:26 Harav Mordechai Yehuda Friedman ענינים על פרשת השבוע פ by Unknown (ID: 33402390)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:13] Skip (not_requested_or_already_downloaded): 40:36 Harav Mordechai Yehuda Friedman ענינים על פרשת השבוע פ by Unknown (ID: 31491953)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:14] Skip (not_requested_or_already_downloaded): 37:40 Harav Mordechai Yehuda Friedman ענינים על פרשת השבוע פ by Unknown (ID: 31428129)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - [p1:15] Skip (not_requested_or_already_downloaded): 42:14 Harav Yitzchak Aharon Goldhirsh בהעלתך, Parashat Beha' by Unknown (ID: 1425021)

2026-06-04 22:03:28,250 - KolHalashonScraper - INFO - reuse_current_page=True -> stopping downloads after the current page

2026-06-04 22:03:28,251 - KolHalashonScraper - INFO - Processed 1 page(s), saw 16 unique shiur IDs

2026-06-04 22:03:28,251 - KolHalashonScraper - INFO - Download complete: 4 downloaded, 0 failed, 12 skipped

2026-06-04 22:03:28,251 - KolHalashonScraper - INFO - Page 1 downloads: 4 downloaded, 0 failed

2026-06-04 22:03:28,260 - KolHalashonScraper - INFO - No more pages available after page 1

2026-06-04 22:03:28,260 - KolHalashonScraper - INFO - URL complete: 16 shiurim extracted from 1 page(s), 16 new total so far

2026-06-04 22:03:29,294 - KolHalashonScraper - INFO - DOM filter debug: {'displayAllSections': 0, 'filterContents': 0, 'filterOptions': 0, 'totalCheckboxes': 0, 'type2Checkboxes': 0}

2026-06-04 22:03:29,304 - KolHalashonScraper - INFO - Extracted 0 speakers from DOM filter checkboxes

2026-06-04 22:03:29,304 - KolHalashonScraper - INFO - [DELAY] Waiting 1.0s between URLs (shiur_url_delay)

2026-06-04 22:03:30,304 - KolHalashonScraper - INFO - Processing URL (id=2): https://www2.kolhalashon.com/regularSite/searchResults/6/-1/-1/-1/-1/New%20Shiurei%20Torah?urlFilters=3:3%7C14:36%7C

2026-06-04 22:03:30,305 - KolHalashonScraper - INFO - Final processed URL: https://www2.kolhalashon.com/regularSite/searchResults/6/-1/-1/-1/-1/New%20Shiurei%20Torah?urlFilters=3:3%7C14:36%7C

2026-06-04 22:03:30,305 - KolHalashonScraper - INFO - STEP 2 visit processed URL: https://www2.kolhalashon.com/regularSite/searchResults/6/-1/-1/-1/-1/New%20Shiurei%20Torah?urlFilters=3:3%7C14:36%7C

2026-06-04 22:03:31,507 - KolHalashonScraper - INFO - Page loaded with 49 shiur containers after 0s

2026-06-04 22:03:31,507 - KolHalashonScraper - INFO - [DELAY] Waiting 70.0s for page content to stabilize (shiur_found_wait)

2026-06-04 22:04:47,546 - KolHalashonScraper - INFO - Processing page 1 of URL (pagination shows: page 1 of 2, has_next=True)

2026-06-04 22:04:47,546 - KolHalashonScraper - INFO - [DELAY] Waiting 6.0s for DOM extraction (dom_extraction_wait)

2026-06-04 22:04:53,562 - KolHalashonScraper - INFO - Extracted 24 shiurim from DOM

2026-06-04 22:04:53,563 - KolHalashonScraper - INFO - Page 1: Browser extracted 24 shiurim

2026-06-04 22:04:53,564 - KolHalashonScraper - INFO - Starting inline downloads for page 1 (reusing current page)

2026-06-04 22:04:53,565 - KolHalashonScraper - WARNING - hdate returned 'בהעלתך' with no match in parsha_list (alternate Hebrew spelling?); checking fallback table for 2026-06-06

2026-06-04 22:04:53,565 - KolHalashonScraper - INFO - Resolved parsha via fallback (spelling variant): Behaalotcha (בהעלותך)

2026-06-04 22:04:53,565 - KolHalashonScraper - INFO - Found current parsha: Behaalotcha (בהעלותך)

2026-06-04 22:04:53,565 - KolHalashonScraper - INFO - Using parsha URL template (id=1): https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?u...

2026-06-04 22:04:53,566 - KolHalashonScraper - INFO - Parsha raw URL template: https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?urlFilters=3:3%7C{speakersfilter}

2026-06-04 22:04:53,566 - KolHalashonScraper - INFO - Speaker IDs for URL id=1: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-06-04 22:04:53,566 - KolHalashonScraper - INFO - Parsha speaker filter string: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-06-04 22:04:53,566 - KolHalashonScraper - INFO - Parsha encoded speaker filter: 2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-06-04 22:04:53,566 - KolHalashonScraper - INFO - Parsha processed URL: https://www2.kolhalashon.com/regularSite/searchResults/1/36/Behaalotcha?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-06-04 22:04:53,566 - KolHalashonScraper - INFO - Download directory: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:04:53,566 - KolHalashonScraper - INFO - Using 1 provided shiur(s) for download (page-derived, in-memory)

2026-06-04 22:04:53,566 - KolHalashonScraper - INFO - Starting download of 1 shiurim (one_per_speaker=True)

2026-06-04 22:04:53,570 - KolHalashonScraper - INFO - Configured download behavior via Browser.setDownloadBehavior CDP for /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:04:53,574 - KolHalashonScraper - INFO - Configured download behavior via Page.setDownloadBehavior CDP for /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:04:53,575 - KolHalashonScraper - INFO - Reusing current page for downloads (no navigation)

2026-06-04 22:04:59,642 - KolHalashonScraper - INFO - Processing page 1 (pagination shows: page 1 of 2, has_next=True)

2026-06-04 22:04:59,655 - KolHalashonScraper - INFO - Page 1 has 24 shiur items

2026-06-04 22:04:59,656 - KolHalashonScraper - INFO - [p1:0] Skip (not_requested_or_already_downloaded): 55:50 Harav Moishe Spielman הדלקת המנורה בבית המקדש - מידה ה by Unknown (ID: 42567373)

2026-06-04 22:04:59,656 - KolHalashonScraper - INFO - [p1:1] Attempting download: 3:17 Harav Ben Zion Sneh השכר לא לפי השגתך- פרשת בהעלותך - ב by Unknown (ID: 42566539)

2026-06-04 22:05:03,243 - KolHalashonScraper - INFO - Extracted media URL for shiur 42566539: https://www.kolhalashon.com/imgs/VideoThumbNails/42562/42562994.jpg

2026-06-04 22:05:03,617 - KolHalashonScraper - INFO - Starting HTTP download: https://www.kolhalashon.com/imgs/VideoThumbNails/42562/42562994.jpg

2026-06-04 22:05:03,710 - KolHalashonScraper - INFO - Download complete: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/42566539_temp.mp3 (13629 bytes)

2026-06-04 22:05:03,711 - KolHalashonScraper - INFO - Renamed: 42566539_temp.mp3 -> KH_השכר לא לפי השגתך- פרשת בהעלותך - באידיש , Parashat Beha'aloscha - Harav Ben Zion Sneh (42566539).mp3

2026-06-04 22:05:03,712 - KolHalashonScraper - INFO - Tagged: KH_השכר לא לפי השגתך- פרשת בהעלותך - באידיש , Parashat Beha'aloscha - Harav Ben Zion Sneh (42566539).mp3 (Harav Ben Zion Sneh — השכר לא לפי השגתך- פרשת בהעלותך - באידיש , Parashat Beha'aloscha)

2026-06-04 22:05:03,712 - KolHalashonScraper - INFO - [p1:1] Direct HTTP download completed: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/KH_השכר לא לפי השגתך- פרשת בהעלותך - באידיש , Parashat Beha'aloscha - Harav Ben Zion Sneh (42566539).mp3

2026-06-04 22:05:03,712 - KolHalashonScraper - INFO - [p1:1] Downloaded: 3:17 Harav Ben Zion Sneh השכר לא לפי השגתך- פרשת בהעלותך - ב by Unknown

2026-06-04 22:05:04,712 - KolHalashonScraper - INFO - [p1:2] Skip (not_requested_or_already_downloaded): 0:58 Harav Chaim Mayer Moses - Eretz Yisrael בסוף עושים שלום by Unknown (ID: 42566386)

2026-06-04 22:05:04,713 - KolHalashonScraper - INFO - [p1:3] Skip (not_requested_or_already_downloaded): 0:56 Harav Chaim Mayer Moses - Eretz Yisrael יששכר וזבולון ש by Unknown (ID: 42566385)

2026-06-04 22:05:04,713 - KolHalashonScraper - INFO - [p1:4] Skip (not_requested_or_already_downloaded): 38:36 Harav Moische Duwid Perelman תּוֹסְפוֹת מְנָחוֹת צ״ה נ by Unknown (ID: 42549773)

2026-06-04 22:05:04,713 - KolHalashonScraper - INFO - [p1:5] Skip (not_requested_or_already_downloaded): 11:14 Harav Daniel Chaim Alter רביעי, Parashat Beha'aloscha, by Unknown (ID: 42548933)

2026-06-04 22:05:04,713 - KolHalashonScraper - INFO - [p1:6] Skip (not_requested_or_already_downloaded): 33:10 Harav Meilech Landau Shiur 191 Parshas Behaaloischu, P by Unknown (ID: 42565237)

2026-06-04 22:05:04,713 - KolHalashonScraper - INFO - [p1:7] Skip (not_requested_or_already_downloaded): 18:42 Harav Menachem Mendel David Hagar - Admor Kasov דברות by Unknown (ID: 42564885)

2026-06-04 22:05:04,713 - KolHalashonScraper - INFO - [p1:8] Skip (not_requested_or_already_downloaded): 2:56 Harav Ben Zion Sneh צריכים לזכור את מה שהיה בדרך בצאתכם by Unknown (ID: 42564825)

2026-06-04 22:05:04,713 - KolHalashonScraper - INFO - [p1:9] Skip (not_requested_or_already_downloaded): Harav Yitzchok Zekl Pollack ‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏ by Unknown (ID: 42564658)

2026-06-04 22:05:04,713 - KolHalashonScraper - INFO - [p1:10] Skip (not_requested_or_already_downloaded): 34:05 Harav Meir Itamar Rosenbaum שיעור נפלא "בפרשת בהעלותך" by Unknown (ID: 42564608)

2026-06-04 22:05:04,713 - KolHalashonScraper - INFO - [p1:11] Skip (not_requested_or_already_downloaded): 25:36 Harav Yehoshua Heshel Sharf Parshas Beha'aloscha , Par by Unknown (ID: 42564606)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:12] Skip (not_requested_or_already_downloaded): 14:27 Harav Daniel Chaim Alter שלישי, Parashat Beha'aloscha, by Unknown (ID: 42547255)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:13] Skip (not_requested_or_already_downloaded): 10:55 Harav Sholom Ahron Ehrenfeld נבואת משה אין תחיית המתים by Unknown (ID: 41747686)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:14] Skip (not_requested_or_already_downloaded): 11:09 Rav Meshilem Bauer בהעלותך - ווי אזוי זעהט מען השגחה פ by Unknown (ID: 42564275)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:15] Skip (not_requested_or_already_downloaded): 15:04 Harav Yechiel Stern R' Yechiel Stern - פרשת בהעלותך-ספ by Unknown (ID: 42564171)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:16] Skip (not_requested_or_already_downloaded): 39:14 Harav Mordechai Yehuda Friedman ענינים על פרשת השבוע פ by Unknown (ID: 42564151)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:17] Skip (not_requested_or_already_downloaded): 2:39 Harav Ben Zion Sneh להתקדם או להתעלות - פרשת בהעלותך - by Unknown (ID: 42564095)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:18] Skip (not_requested_or_already_downloaded): 16:16 Harav Daniel Chaim Alter שני, Parashat Beha'aloscha, S by Unknown (ID: 42545536)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:19] Skip (not_requested_or_already_downloaded): 1:16:06 Harav Eliyahu Shorr עשק בהעלותך פו בענין האנשים אשר by Unknown (ID: 42563167)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:20] Skip (not_requested_or_already_downloaded): 2:28 Harav Ben Zion Sneh תהיה תרמוסטט ולא מדחום - פרשת בהעלו by Unknown (ID: 42562994)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:21] Skip (not_requested_or_already_downloaded): 14:05 Harav Daniel Chaim Alter ראשון, Parashat Beha'aloscha, by Unknown (ID: 42544018)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:22] Skip (not_requested_or_already_downloaded): 28:38 The Rebbe of Dinov סעודה שלישית תשפו בהעלותך, Parashat by Unknown (ID: 42562528)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - [p1:23] Skip (not_requested_or_already_downloaded): 14:55 Harav Yochanan Shain שבת אחים ליל שישי בהעלותך חלק ג' by Unknown (ID: 42562441)

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - reuse_current_page=True -> stopping downloads after the current page

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - Processed 1 page(s), saw 24 unique shiur IDs

2026-06-04 22:05:04,714 - KolHalashonScraper - INFO - Download complete: 1 downloaded, 0 failed, 23 skipped

2026-06-04 22:05:04,715 - KolHalashonScraper - INFO - Page 1 downloads: 1 downloaded, 0 failed

2026-06-04 22:05:04,725 - KolHalashonScraper - INFO - No more pages available after page 1

2026-06-04 22:05:04,725 - KolHalashonScraper - INFO - URL complete: 24 shiurim extracted from 1 page(s), 40 new total so far

2026-06-04 22:05:05,757 - KolHalashonScraper - INFO - DOM filter debug: {'displayAllSections': 0, 'filterContents': 1, 'filterOptions': 43, 'totalCheckboxes': 41, 'type2Checkboxes': 0}

2026-06-04 22:05:05,766 - KolHalashonScraper - INFO - Extracted 0 speakers from DOM filter checkboxes

2026-06-04 22:05:05,766 - KolHalashonScraper - INFO - [DELAY] Waiting 1.0s between URLs (shiur_url_delay)

2026-06-04 22:05:06,766 - KolHalashonScraper - INFO - Processing URL (id=8): https://www.kolhalashon.com/en/regularSite/searchResults/100/49/Meilah?urlFilters=3:3%7C20:23%7C{speakersfilter}

2026-06-04 22:05:06,767 - KolHalashonScraper - INFO - Replaced speakersfilter placeholder with 5 speaker filter(s)

2026-06-04 22:05:06,767 - KolHalashonScraper - INFO - Final processed URL: https://www.kolhalashon.com/en/regularSite/searchResults/100/49/Meilah?urlFilters=3:3%7C20:23%7C2:7651%7C2:1608%7C2:7011%7C2:1762%7C2:7163

2026-06-04 22:05:06,767 - KolHalashonScraper - INFO - STEP 2 visit processed URL: https://www.kolhalashon.com/en/regularSite/searchResults/100/49/Meilah?urlFilters=3:3%7C20:23%7C2:7651%7C2:1608%7C2:7011%7C2:1762%7C2:7163

2026-06-04 22:05:07,860 - KolHalashonScraper - INFO - Page loaded with 49 shiur containers after 0s

2026-06-04 22:05:07,860 - KolHalashonScraper - INFO - [DELAY] Waiting 70.0s for page content to stabilize (shiur_found_wait)

2026-06-04 22:06:23,901 - KolHalashonScraper - INFO - Processing page 1 of URL (pagination shows: page 1 of 1, has_next=False)

2026-06-04 22:06:23,901 - KolHalashonScraper - INFO - [DELAY] Waiting 6.0s for DOM extraction (dom_extraction_wait)

2026-06-04 22:06:29,914 - KolHalashonScraper - INFO - Extracted 4 shiurim from DOM

2026-06-04 22:06:29,914 - KolHalashonScraper - INFO - Page 1: Browser extracted 4 shiurim

2026-06-04 22:06:29,915 - KolHalashonScraper - INFO - Starting inline downloads for page 1 (reusing current page)

2026-06-04 22:06:29,915 - KolHalashonScraper - WARNING - hdate returned 'בהעלתך' with no match in parsha_list (alternate Hebrew spelling?); checking fallback table for 2026-06-06

2026-06-04 22:06:29,916 - KolHalashonScraper - INFO - Resolved parsha via fallback (spelling variant): Behaalotcha (בהעלותך)

2026-06-04 22:06:29,916 - KolHalashonScraper - INFO - Found current parsha: Behaalotcha (בהעלותך)

2026-06-04 22:06:29,916 - KolHalashonScraper - INFO - Using parsha URL template (id=1): https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?u...

2026-06-04 22:06:29,916 - KolHalashonScraper - INFO - Parsha raw URL template: https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?urlFilters=3:3%7C{speakersfilter}

2026-06-04 22:06:29,916 - KolHalashonScraper - INFO - Speaker IDs for URL id=1: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-06-04 22:06:29,916 - KolHalashonScraper - INFO - Parsha speaker filter string: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-06-04 22:06:29,916 - KolHalashonScraper - INFO - Parsha encoded speaker filter: 2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-06-04 22:06:29,916 - KolHalashonScraper - INFO - Parsha processed URL: https://www2.kolhalashon.com/regularSite/searchResults/1/36/Behaalotcha?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-06-04 22:06:29,917 - KolHalashonScraper - INFO - Download directory: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:06:29,917 - KolHalashonScraper - INFO - Using 1 provided shiur(s) for download (page-derived, in-memory)

2026-06-04 22:06:29,917 - KolHalashonScraper - INFO - Starting download of 1 shiurim (one_per_speaker=True)

2026-06-04 22:06:29,921 - KolHalashonScraper - INFO - Configured download behavior via Browser.setDownloadBehavior CDP for /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:06:29,925 - KolHalashonScraper - INFO - Configured download behavior via Page.setDownloadBehavior CDP for /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-04 22:06:29,925 - KolHalashonScraper - INFO - Reusing current page for downloads (no navigation)

2026-06-04 22:06:35,981 - KolHalashonScraper - INFO - Processing page 1 (pagination shows: page 1 of 1, has_next=False)

2026-06-04 22:06:35,989 - KolHalashonScraper - INFO - Page 1 has 4 shiur items

2026-06-04 22:06:35,989 - KolHalashonScraper - INFO - [p1:0] Skip (not_requested_or_already_downloaded): 56:25 Harav Elazar Nissan Rubin Masechet Meilah, Daf 23 Shiu by Unknown (ID: 41492651)

2026-06-04 22:06:35,989 - KolHalashonScraper - INFO - [p1:1] Attempting download: 1:02:42 Harav Shmuel Dovid Friedman דף כג, Masechet Meilah, by Unknown (ID: 353525)

2026-06-04 22:06:39,644 - KolHalashonScraper - INFO - Extracted media URL for shiur 353525: https://www.kolhalashon.com/api/files/GetMp3FileToPlay/353525

2026-06-04 22:06:39,900 - KolHalashonScraper - INFO - Starting HTTP download: https://www.kolhalashon.com/api/files/GetMp3FileToPlay/353525

2026-06-04 22:06:41,335 - KolHalashonScraper - INFO - Download complete: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/353525_temp.mp3 (15160531 bytes)

2026-06-04 22:06:41,336 - KolHalashonScraper - INFO - Renamed: 353525_temp.mp3 -> KH_דף כג, Masechet Meilah, Daf 23 - Harav Shmuel Dovid Friedman (353525).mp3

2026-06-04 22:06:41,338 - KolHalashonScraper - INFO - Tagged: KH_דף כג, Masechet Meilah, Daf 23 - Harav Shmuel Dovid Friedman (353525).mp3 (Harav Shmuel Dovid Friedman — דף כג, Masechet Meilah, Daf 23)

2026-06-04 22:06:41,339 - KolHalashonScraper - INFO - [p1:1] Direct HTTP download completed: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio/KH_דף כג, Masechet Meilah, Daf 23 - Harav Shmuel Dovid Friedman (353525).mp3

2026-06-04 22:06:41,339 - KolHalashonScraper - INFO - [p1:1] Downloaded: 1:02:42 Harav Shmuel Dovid Friedman דף כג, Masechet Meilah, by Unknown

2026-06-04 22:06:42,339 - KolHalashonScraper - INFO - [p1:2] Skip (not_requested_or_already_downloaded): 57:44 Harav Elazar Nissan Rubin Masechet Meilah, Daf 23 Shiu by Unknown (ID: 41230883)

2026-06-04 22:06:42,339 - KolHalashonScraper - INFO - [p1:3] Skip (not_requested_or_already_downloaded): 1:02:42 Harav Shmuel Dovid Friedman Masechet Meilah, Daf 23 by Unknown (ID: 41215697)

2026-06-04 22:06:42,339 - KolHalashonScraper - INFO - reuse_current_page=True -> stopping downloads after the current page

2026-06-04 22:06:42,339 - KolHalashonScraper - INFO - Processed 1 page(s), saw 4 unique shiur IDs

2026-06-04 22:06:42,339 - KolHalashonScraper - INFO - Download complete: 1 downloaded, 0 failed, 3 skipped

2026-06-04 22:06:42,339 - KolHalashonScraper - INFO - Page 1 downloads: 1 downloaded, 0 failed

2026-06-04 22:06:42,344 - KolHalashonScraper - INFO - No more pages available after page 1

2026-06-04 22:06:42,344 - KolHalashonScraper - INFO - URL complete: 4 shiurim extracted from 1 page(s), 44 new total so far

2026-06-04 22:06:43,365 - KolHalashonScraper - INFO - DOM filter debug: {'displayAllSections': 0, 'filterContents': 1, 'filterOptions': 47, 'totalCheckboxes': 41, 'type2Checkboxes': 41}

2026-06-04 22:06:43,373 - KolHalashonScraper - INFO - Extracted 0 speakers from DOM filter checkboxes

2026-06-04 22:06:43,373 - KolHalashonScraper - INFO - [DELAY] Waiting 1.0s between URLs (shiur_url_delay)

2026-06-04 22:06:44,374 - KolHalashonScraper - INFO - Multi-URL scrape complete: 44 new shiurim from 3 URLs (3 total pages), 44 total checked

2026-06-04 22:06:44,374 - KolHalashonScraper - INFO - [parsha:1/44] match | ID: 42564151 | ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha | Speaker: Harav Mordechai Yehuda Friedman

2026-06-04 22:06:44,377 - KolHalashonScraper - INFO - [parsha:2/44] match | ID: 42561410 | פרשת בהעלותך תשפו, Parashat Beha'aloscha | Speaker: Harav Yitzchak Aharon Goldhirsh

2026-06-04 22:06:44,377 - KolHalashonScraper - INFO - [parsha:3/44] match | ID: 41815361 | Parashat Beha'aloscha, Sefer Ohr Hachaim, Part 2 | Speaker: Harav Elazar Nissan Rubin

2026-06-04 22:06:44,377 - KolHalashonScraper - INFO - [parsha:4/44] match | ID: 41754339 | Parashat Beha'aloscha | Speaker: Harav Chaim Shlomo Miller

2026-06-04 22:06:44,377 - KolHalashonScraper - INFO - [parsha:5/44] match | ID: 41754098 | Parashat Beha'aloscha, Part 3 | Speaker: Harav Elazar Nissan Rubin

2026-06-04 22:06:44,377 - KolHalashonScraper - INFO - [parsha:6/44] match | ID: 41754099 | Parashat Beha'aloscha, Part 2 | Speaker: Harav Elazar Nissan Rubin

2026-06-04 22:06:44,377 - KolHalashonScraper - INFO - [parsha:7/44] match | ID: 41753092 | פרשת בהעלתך תשפ"ה, Parashat Beha'aloscha | Speaker: Harav Yitzchak Aharon Goldhirsh

2026-06-04 22:06:44,377 - KolHalashonScraper - INFO - [parsha:8/44] match | ID: 41750926 | Parashat Beha'aloscha, Part 1 | Speaker: Harav Elazar Nissan Rubin

2026-06-04 22:06:44,377 - KolHalashonScraper - INFO - [parsha:9/44] match | ID: 41749767 | Parashat Beha'aloscha, Sefer Ohr Hachaim, Part 1 | Speaker: Harav Elazar Nissan Rubin

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:10/44] match | ID: 41797123 | יום ב , Parashat Beha'aloscha | Speaker: Harav Yitzchak Aharon Goldhirsh

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:11/44] match | ID: 41795497 | יום א פרשת בהעלותך, Parashat Beha'aloscha | Speaker: Harav Yitzchak Aharon Goldhirsh

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:12/44] match | ID: 35353554 | ענינים על פרשת השבוע פרשת בהעלתך, Parashat Beha'aloscha | Speaker: Harav Mordechai Yehuda Friedman

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:13/44] match | ID: 33402390 | ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha | Speaker: Harav Mordechai Yehuda Friedman

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:14/44] match | ID: 31491953 | ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha | Speaker: Harav Mordechai Yehuda Friedman

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:15/44] match | ID: 31428129 | ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha | Speaker: Harav Mordechai Yehuda Friedman

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:16/44] match | ID: 1425021 | בהעלתך, Parashat Beha'aloscha | Speaker: Harav Yitzchak Aharon Goldhirsh

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:17/44] match | ID: 42567373 | הדלקת המנורה בבית המקדש - מידה הענוה - פנינים וחידושים, Parashat Beha'aloscha | Speaker: Harav Moishe Spielman

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:18/44] match | ID: 42566539 | השכר לא לפי השגתך- פרשת בהעלותך - באידיש , Parashat Beha'aloscha | Speaker: Harav Ben Zion Sneh

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:19/44] match | ID: 42566386 | בסוף עושים שלום ואתה נשאר לבד במחלוקת, Parashat Beha'aloscha | Speaker: Harav Chaim Mayer Moses - Eretz Yisrael

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:20/44] match | ID: 42566385 | יששכר וזבולון שותפות בהעלותך חק זוהר, Parashat Beha'aloscha, Sefer Zohar | Speaker: Harav Chaim Mayer Moses - Eretz Yisrael

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:21/44] match | ID: 42549773 | תּוֹסְפוֹת מְנָחוֹת צ״ה נְסִיעָה בִּתְחִלַּת הַיּוֹם אוֹ הַלַּיְלָה תָּלוּי בִּש | Speaker: Harav Moische Duwid Perelman

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:22/44] match | ID: 42548933 | רביעי, Parashat Beha'aloscha, Sefer Chumas Rashi | Speaker: Harav Daniel Chaim Alter

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:23/44] match | ID: 42565237 | Shiur 191 Parshas Behaaloischu, Parashat Beha'aloscha | Speaker: Harav Meilech Landau

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:24/44] match | ID: 42564885 | דברות קודש רעווא דרעווין - בהעלתך תשפ''ה, Parashat Beha'aloscha | Speaker: Harav Menachem Mendel David Hagar - Admor Kasov

2026-06-04 22:06:44,378 - KolHalashonScraper - INFO - [parsha:25/44] match | ID: 42564825 | צריכים לזכור את מה שהיה בדרך בצאתכם ממצרים - פרשת בהעלותך - באידיש , Parashat Be | Speaker: Harav Ben Zion Sneh

2026-06-04 22:06:44,379 - KolHalashonScraper - INFO - [parsha:26/44] match | ID: 42564658 | ‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏(גליון 47) אור הדעת - בהעלותך - תשפ''ו, | Speaker: Harav Yitzchok Zekl Pollack

2026-06-04 22:06:44,379 - KolHalashonScraper - INFO - [parsha:27/44] match | ID: 42564608 | שיעור נפלא "בפרשת בהעלותך" תשפ"ו (חו"ל), Parashat Beha'aloscha | Speaker: Harav Meir Itamar Rosenbaum

2026-06-04 22:06:44,379 - KolHalashonScraper - INFO - [parsha:28/44] match | ID: 42564606 | Parshas Beha'aloscha , Parashat Beha'aloscha, Sefer Chumas Rashi | Speaker: Harav Yehoshua Heshel Sharf

2026-06-04 22:06:44,379 - KolHalashonScraper - INFO - [parsha:29/44] match | ID: 42547255 | שלישי, Parashat Beha'aloscha, Sefer Chumas Rashi | Speaker: Harav Daniel Chaim Alter

2026-06-04 22:06:44,379 - KolHalashonScraper - INFO - [parsha:30/44] match | ID: 41747686 | נבואת משה אין תחיית המתים מוראדיגע חידוש פון שומרי אמונים הקדמון, Parashat Beha' | Speaker: Harav Sholom Ahron Ehrenfeld

2026-06-04 22:06:44,379 - KolHalashonScraper - INFO - [parsha:31/44] match | ID: 42564275 | בהעלותך - ווי אזוי זעהט מען השגחה פרטיות, Parashat Beha'aloscha | Speaker: Rav Meshilem Bauer

2026-06-04 22:06:44,379 - KolHalashonScraper - INFO - [parsha:32/44] match | ID: 42564171 | R' Yechiel Stern - פרשת בהעלותך-ספר כלי יקר-הצאן ובקר ישחט להם ומצא להםם - 06-01 | Speaker: Harav Yechiel Stern

2026-06-04 22:06:44,379 - KolHalashonScraper - INFO - [parsha:33/44] match | ID: 42564151 | ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha | Speaker: Harav Mordechai Yehuda Friedman

2026-06-04 22:06:44,379 - KolHalashonScraper - INFO - [parsha:34/44] match | ID: 42564095 | להתקדם או להתעלות - פרשת בהעלותך - באידיש , Parashat Beha'aloscha | Speaker: Harav Ben Zion Sneh

2026-06-04 22:06:44,379 - KolHalashonScraper - INFO - [parsha:35/44] match | ID: 42545536 | שני, Parashat Beha'aloscha, Sefer Chumas Rashi | Speaker: Harav Daniel Chaim Alter

2026-06-04 22:06:44,380 - KolHalashonScraper - INFO - [parsha:36/44] match | ID: 42563167 | עשק בהעלותך פו בענין האנשים אשר היו טמאים ושוחטין וזורקים על טמא מת, Parashat B | Speaker: Harav Eliyahu Shorr

2026-06-04 22:06:44,380 - KolHalashonScraper - INFO - [parsha:37/44] match | ID: 42562994 | תהיה תרמוסטט ולא מדחום - פרשת בהעלותך - באידיש , Parashat Beha'aloscha | Speaker: Harav Ben Zion Sneh

2026-06-04 22:06:44,380 - KolHalashonScraper - INFO - [parsha:38/44] match | ID: 42544018 | ראשון, Parashat Beha'aloscha, Sefer Chumas Rashi | Speaker: Harav Daniel Chaim Alter

2026-06-04 22:06:44,380 - KolHalashonScraper - INFO - [parsha:39/44] match | ID: 42562528 | סעודה שלישית תשפו בהעלותך, Parashat Beha'aloscha | Speaker: The Rebbe of Dinov

2026-06-04 22:06:44,380 - KolHalashonScraper - INFO - [parsha:40/44] match | ID: 42562441 | שבת אחים ליל שישי בהעלותך חלק ג' על ידי נגינה בשבת קודש מכניסים אמונה לתוך הלב, | Speaker: Harav Yochanan Shain

2026-06-04 22:06:44,380 - KolHalashonScraper - INFO - [parsha:41/44] match | ID: 41492651 | Masechet Meilah, Daf 23 | Speaker: Harav Elazar Nissan Rubin

2026-06-04 22:06:44,380 - KolHalashonScraper - INFO - [parsha:42/44] match | ID: 353525 | דף כג, Masechet Meilah, Daf 23 | Speaker: Harav Shmuel Dovid Friedman

2026-06-04 22:06:44,380 - KolHalashonScraper - INFO - [parsha:43/44] match | ID: 41230883 | Masechet Meilah, Daf 23 | Speaker: Harav Elazar Nissan Rubin

2026-06-04 22:06:44,380 - KolHalashonScraper - INFO - [parsha:44/44] match | ID: 41215697 | Masechet Meilah, Daf 23 | Speaker: Harav Shmuel Dovid Friedman

2026-06-04 22:06:44,380 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha by Harav Mordechai Yehuda Friedman

2026-06-04 22:06:44,381 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: פרשת בהעלותך תשפו, Parashat Beha'aloscha by Harav Yitzchak Aharon Goldhirsh

2026-06-04 22:06:44,381 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Parashat Beha'aloscha, Sefer Ohr Hachaim, Part 2 by Harav Elazar Nissan Rubin

2026-06-04 22:06:44,381 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Parashat Beha'aloscha by Harav Chaim Shlomo Miller

2026-06-04 22:06:44,381 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Parashat Beha'aloscha, Part 3 by Harav Elazar Nissan Rubin

2026-06-04 22:06:44,381 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Parashat Beha'aloscha, Part 2 by Harav Elazar Nissan Rubin

2026-06-04 22:06:44,381 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: פרשת בהעלתך תשפ"ה, Parashat Beha'aloscha by Harav Yitzchak Aharon Goldhirsh

2026-06-04 22:06:44,381 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Parashat Beha'aloscha, Part 1 by Harav Elazar Nissan Rubin

2026-06-04 22:06:44,382 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Parashat Beha'aloscha, Sefer Ohr Hachaim, Part 1 by Harav Elazar Nissan Rubin

2026-06-04 22:06:44,382 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: יום ב , Parashat Beha'aloscha by Harav Yitzchak Aharon Goldhirsh

2026-06-04 22:06:44,382 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: יום א פרשת בהעלותך, Parashat Beha'aloscha by Harav Yitzchak Aharon Goldhirsh

2026-06-04 22:06:44,382 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: ענינים על פרשת השבוע פרשת בהעלתך, Parashat Beha'aloscha by Harav Mordechai Yehuda Friedman

2026-06-04 22:06:44,382 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: ענינים על פרשת השבוע פרשת בהעלותך, Parashat Beha'aloscha by Harav Mordechai Yehuda Friedman

2026-06-04 22:06:44,382 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: בהעלתך, Parashat Beha'aloscha by Harav Yitzchak Aharon Goldhirsh

2026-06-04 22:06:44,382 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: הדלקת המנורה בבית המקדש - מידה הענוה - פנינים וחידושים, Parashat Beha'aloscha by Harav Moishe Spielman

2026-06-04 22:06:44,382 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: השכר לא לפי השגתך- פרשת בהעלותך - באידיש , Parashat Beha'aloscha by Harav Ben Zion Sneh

2026-06-04 22:06:44,382 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: בסוף עושים שלום ואתה נשאר לבד במחלוקת, Parashat Beha'aloscha by Harav Chaim Mayer Moses - Eretz Yisrael

2026-06-04 22:06:44,382 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: יששכר וזבולון שותפות בהעלותך חק זוהר, Parashat Beha'aloscha, Sefer Zohar by Harav Chaim Mayer Moses - Eretz Yisrael

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: תּוֹסְפוֹת מְנָחוֹת צ״ה נְסִיעָה בִּתְחִלַּת הַיּוֹם אוֹ הַלַּיְלָה תָּלוּי בִּשְׁנֵי פֵּירוּשֵׁי הָאֶבֶן עֶזְרָא, Parashat Beha'aloscha by Harav Moische Duwid Perelman

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: רביעי, Parashat Beha'aloscha, Sefer Chumas Rashi by Harav Daniel Chaim Alter

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Shiur 191 Parshas Behaaloischu, Parashat Beha'aloscha by Harav Meilech Landau

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: דברות קודש רעווא דרעווין - בהעלתך תשפ''ה, Parashat Beha'aloscha by Harav Menachem Mendel David Hagar - Admor Kasov

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: צריכים לזכור את מה שהיה בדרך בצאתכם ממצרים - פרשת בהעלותך - באידיש , Parashat Beha'aloscha by Harav Ben Zion Sneh

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: ‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏‏(גליון 47) אור הדעת - בהעלותך - תשפ''ו, Parashat Beha'aloscha by Harav Yitzchok Zekl Pollack

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: שיעור נפלא "בפרשת בהעלותך" תשפ"ו (חו"ל), Parashat Beha'aloscha by Harav Meir Itamar Rosenbaum

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Parshas Beha'aloscha , Parashat Beha'aloscha, Sefer Chumas Rashi by Harav Yehoshua Heshel Sharf

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: שלישי, Parashat Beha'aloscha, Sefer Chumas Rashi by Harav Daniel Chaim Alter

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: נבואת משה אין תחיית המתים מוראדיגע חידוש פון שומרי אמונים הקדמון, Parashat Beha'aloscha by Harav Sholom Ahron Ehrenfeld

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: בהעלותך - ווי אזוי זעהט מען השגחה פרטיות, Parashat Beha'aloscha by Rav Meshilem Bauer

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: R' Yechiel Stern - פרשת בהעלותך-ספר כלי יקר-הצאן ובקר ישחט להם ומצא להםם - 06-01-26, Parashat Beha'aloscha, Sefer Kli Yakar, Chapter 11, Pasuk 21 by Harav Yechiel Stern

2026-06-04 22:06:44,383 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: להתקדם או להתעלות - פרשת בהעלותך - באידיש , Parashat Beha'aloscha by Harav Ben Zion Sneh

2026-06-04 22:06:44,384 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: שני, Parashat Beha'aloscha, Sefer Chumas Rashi by Harav Daniel Chaim Alter

2026-06-04 22:06:44,384 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: עשק בהעלותך פו בענין האנשים אשר היו טמאים ושוחטין וזורקים על טמא מת, Parashat Beha'aloscha by Harav Eliyahu Shorr

2026-06-04 22:06:44,384 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: תהיה תרמוסטט ולא מדחום - פרשת בהעלותך - באידיש , Parashat Beha'aloscha by Harav Ben Zion Sneh

2026-06-04 22:06:44,384 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: ראשון, Parashat Beha'aloscha, Sefer Chumas Rashi by Harav Daniel Chaim Alter

2026-06-04 22:06:44,384 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: סעודה שלישית תשפו בהעלותך, Parashat Beha'aloscha by The Rebbe of Dinov

2026-06-04 22:06:44,384 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: שבת אחים ליל שישי בהעלותך חלק ג' על ידי נגינה בשבת קודש מכניסים אמונה לתוך הלב, Parashat Beha'aloscha by Harav Yochanan Shain

2026-06-04 22:06:44,384 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Masechet Meilah, Daf 23 by Harav Elazar Nissan Rubin

2026-06-04 22:06:44,384 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: דף כג, Masechet Meilah, Daf 23 by Harav Shmuel Dovid Friedman

2026-06-04 22:06:44,385 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Masechet Meilah, Daf 23 by Harav Elazar Nissan Rubin

2026-06-04 22:06:44,385 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - New shiur added: Masechet Meilah, Daf 23 by Harav Shmuel Dovid Friedman

2026-06-04 22:06:44,395 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - Shiurim sync complete: 43 new, 1 already in db, 842 total

2026-06-04 22:06:44,395 - KolHalashonScraper - INFO - Parsha shiurim: 43 new, 44 match filter, 44 total

2026-06-04 22:06:44,395 - KolHalashonScraper - INFO - Kol Halashon scraping complete: 43 NEW shiurim for email, 43 total new, 44 match filter (all)

2026-06-04 22:06:44,395 - __main__ - INFO - Scraper kolhalashon completed: 43 results

2026-06-04 22:06:45,268 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-04 22:06:45.268432

2026-06-04 22:06:45,268 - __main__ - INFO - Email sent successfully

2026-06-04 22:06:45,269 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-04 22:06:45,269 - __main__ - INFO - Monitor complete. Found 43 total results: 43 new kolhalashon results.

2026-06-04 22:06:45,269 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-04 22:06:45,269 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-04 22:06:45,280 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-04 22:06:45,280 - __main__ - INFO - Closed all database connections

2026-06-04 22:06:45,282 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-04 22:06:45,282 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-04 22:30:02,132 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-04.log

2026-06-04 22:30:02,133 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-04.log

2026-06-04 22:30:02,133 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-04.log

2026-06-04 22:30:02,133 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-04 22:30:02,166 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-04 22:30:02,166 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-06-04 22:30:02,166 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-04 22:30:02,168 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-04 22:30:02,168 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-04 22:30:02,191 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-04 22:30:02,191 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-04 22:30:02,192 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-04 22:30:02,192 - __main__ - INFO - Reddit scraper initialized and enabled

2026-06-04 22:30:02,192 - __main__ - INFO - GitHub scraper initialized and enabled

2026-06-04 22:30:02,192 - __main__ - INFO - Twitter scraper initialized and enabled

2026-06-04 22:30:02,193 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-04 22:30:02,193 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-06-04 22:30:02,193 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-06-04 22:30:02,196 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled

2026-06-04 22:30:02,196 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0

2026-06-04 22:30:02,198 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-04 22:30:02,202 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-06-04 22:30:02,202 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-06-04 22:30:02,204 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-04 22:30:02,204 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-06-04 22:30:02,205 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-04 22:30:02,205 - __main__ - INFO - Running 5 scrapers concurrently...

2026-06-04 22:30:02,205 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-04 22:30:02,205 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-06-04 22:30:02,500 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 3 entries for term '"Hermes Agent"'

2026-06-04 22:30:03,575 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-06-04 22:30:03,575 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-06-04 22:30:03,575 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-06-04 22:30:03,575 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-06-04 22:30:04,802 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-06-04 22:30:04,911 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Pureflow camera

2026-06-04 22:30:06,104 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1

2026-06-04 22:30:06,104 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-06-04 22:30:06,104 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-06-04 22:30:06,104 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-06-04 22:30:06,874 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-06-04 22:30:08,105 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-06-04 22:30:08,106 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-06-04 22:30:08,106 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-06-04 22:30:08,106 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-06-04 22:30:08,886 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/HermesAgentTips: Hermes Agent model routing guide: Agent security checklist without the

2026-06-04 22:30:08,901 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Unpopular opinion: Hermes Agent takes the path of Openclaw and that's

2026-06-04 22:30:08,912 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MercuryInstall: Mercury Agent install note: Mercury Second Brain memory without the se

2026-06-04 22:30:08,920 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Local LLM Qwen3.5 9B for Hermes Agent?

2026-06-04 22:30:08,930 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/Timeplus: Human and AI Agent Interaction: Patterns and Outcomes from Real-Time T

2026-06-04 22:30:10,078 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-06-04 22:30:11,942 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-06-04 22:30:13,038 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/RepLadiesClub: New and Overwhelmed

2026-06-04 22:30:13,045 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Opinions on Nous Portal

2026-06-04 22:30:13,052 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/arsmagica: Applying RAW to the Founding, Part I

2026-06-04 22:30:14,236 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-06-04 22:30:16,356 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-06-04 22:30:16,356 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-06-04 22:30:18,878 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-06-04 22:30:21,123 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-06-04 22:30:23,379 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-06-04 22:30:23,380 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-06-04 22:30:25,366 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 8

2026-06-04 22:30:25,367 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-04 22:30:25,522 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-04 22:30:25,981 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-06-04 22:30:39,648 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-06-04 22:30:53,122 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-06-04 22:31:06,143 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-06-04 22:31:06,144 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-04 22:31:06,745 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-06-04 22:31:07,935 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-06-04 22:31:08,373 - LinkedInScraper - INFO - New LinkedIn post: I Plugged Minimax M3 Model Into Hermes And It Worked - LinkedIn

2026-06-04 22:31:08,388 - LinkedInScraper - INFO - New LinkedIn post: New Google Gemma 4 Update is Insane (FREE!) 🤯 - LinkedIn

2026-06-04 22:31:08,411 - LinkedInScraper - INFO - New LinkedIn post: Veille - Claude Code + Hermes Agent : what the combo really changes in

2026-06-04 22:31:08,418 - LinkedInScraper - INFO - New LinkedIn post: Memory OS Fixes Hermes Agent Memory Issues with 6‑Layer Stack Hermes A

2026-06-04 22:31:08,678 - LinkedInScraper - INFO - New LinkedIn post: I ranked a video #1 on Google in 19 hours using free AI… Here’s how👇 M

2026-06-04 22:31:08,712 - LinkedInScraper - INFO - New LinkedIn post: AIエージェントを増やしても、自動化は進まなかった。Hermes Agent司令塔を作って初日に気づいたこと｜NaoyaCreates -

2026-06-04 22:31:09,354 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-06-04 22:31:09,563 - LinkedInScraper - INFO - New LinkedIn post: Nicolas Daniel - France | Profil professionnel - LinkedIn

2026-06-04 22:31:09,715 - LinkedInScraper - INFO - New LinkedIn post: Imed-Eddine BOUKHARI - Intern @INRAE | M2 Vision et Machine Intelligen

2026-06-04 22:31:09,829 - LinkedInScraper - INFO - New LinkedIn post: Blessing Taiwo - Music Facilitator, Recreational Aide, Activity Aide,

2026-06-04 22:31:09,854 - LinkedInScraper - INFO - New LinkedIn post: Vice President of Patient Care Services/Chief Nursing Officer UChicago

2026-06-04 22:31:09,887 - LinkedInScraper - INFO - New LinkedIn post: Junwen S. - current MSc student at University of Alberta - LinkedIn

2026-06-04 22:31:09,926 - LinkedInScraper - INFO - New LinkedIn post: Cherine Fernandes - Department Administrator & Director of Operations

2026-06-04 22:31:09,933 - LinkedInScraper - INFO - New LinkedIn post: Rhett Buckley - Northwestern Medicine - LinkedIn

2026-06-04 22:31:10,023 - LinkedInScraper - INFO - New LinkedIn post: Vanessa Rodriguez - Registered Respiratory Therapist - LinkedIn

2026-06-04 22:31:10,030 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 14 new results.

2026-06-04 22:31:10,030 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-06-04 22:31:15,956 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-04 22:31:15,980 - GitHubScraper - INFO - Found 236 GitHub repositories for term: paperclip

2026-06-04 22:31:16,987 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-04 22:31:16,990 - GitHubScraper - INFO - Found 321 GitHub repositories for term: "Hermes Agent"

2026-06-04 22:31:17,963 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-04 22:31:17,967 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica

2026-06-04 22:31:18,101 - GitHubScraper - INFO - Total GitHub results found: 0

2026-06-04 22:31:18,101 - __main__ - INFO - Scraper reddit completed: 9 results

2026-06-04 22:31:18,102 - __main__ - INFO - Scraper github completed: 0 results

2026-06-04 22:31:18,102 - __main__ - INFO - Scraper twitter completed: 0 results

2026-06-04 22:31:18,102 - __main__ - INFO - Scraper linkedin completed: 14 results

2026-06-04 22:31:18,102 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-06-04 22:31:18,896 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-04 22:31:18.896471

2026-06-04 22:31:18,896 - __main__ - INFO - Email sent successfully

2026-06-04 22:31:18,897 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-04 22:31:18,897 - __main__ - INFO - Monitor complete. Found 23 total results: 9 new reddit results, 14 new linkedin results.

2026-06-04 22:31:18,897 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-04 22:31:18,897 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-04 22:31:19,022 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-04 22:31:19,022 - __main__ - INFO - Closed all database connections

2026-06-04 22:31:19,066 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-04 22:31:19,079 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-04 23:00:02,045 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-04.log

2026-06-04 23:00:02,045 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-04.log

2026-06-04 23:00:02,045 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-04.log

2026-06-04 23:00:02,045 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-04 23:00:02,087 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-04 23:00:02,087 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-04 23:00:02,089 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-04 23:00:02,090 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-04 23:00:02,110 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-04 23:00:02,110 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-04 23:00:02,167 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-04 23:00:02,168 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-04 23:00:02,169 - __main__ - INFO - RSS scraper initialized and enabled

2026-06-04 23:00:02,175 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled

2026-06-04 23:00:02,176 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0

2026-06-04 23:00:02,176 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-06-04 23:00:02,183 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-04 23:00:02,192 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-06-04 23:00:02,193 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-06-04 23:00:02,197 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-04 23:00:02,197 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-06-04 23:00:02,197 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-04 23:00:02,198 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-06-04 23:00:02,198 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-04 23:00:02,198 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-06-04 23:00:02,288 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-06-04 23:00:02,292 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters

2026-06-04 23:00:02,292 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-06-04 23:00:02,295 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-06-04 23:00:02,640 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-06-04 23:00:03,147 - RSSFeedScraper - INFO - Total RSS/HTML results: 4

2026-06-04 23:00:06,468 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-06-04 23:00:06,652 - Yiddish24Scraper - INFO - Received response with 478763 characters

2026-06-04 23:00:06,655 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (310252 chars)

2026-06-04 23:00:06,658 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-06-04 23:00:06,740 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-06-04 23:00:06,783 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-06-04 23:00:06,784 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-06-04 23:00:06,800 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-06-04 23:00:06,800 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-06-04 23:00:07,501 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/NITZLECH_house_260_260604060211.mp3

2026-06-04 23:00:10,144 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_NITZLECH_house_260_260604060211.mp3 (71.3 MB)

2026-06-04 23:00:10,145 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-06-04 23:00:10,182 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_NITZLECH_house_260_260604060211.mp3: title, artist, album, comment, source_url, genre, publisher

2026-06-04 23:00:10,182 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_NITZLECH_house_260_260604060211_הכל_בכל.mp3

2026-06-04 23:00:11,195 - Yiddish24Scraper - INFO - Page 1 summary: 2 new out of 100 total articles

2026-06-04 23:00:11,195 - Yiddish24Scraper - INFO - Page 1: 2/100 new items

2026-06-04 23:00:11,195 - Yiddish24Scraper - INFO - Low new item ratio (2.0%), stopping pagination

2026-06-04 23:00:11,195 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 2

2026-06-04 23:00:13,824 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-06-04 23:00:22,520 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 6 new posts.

2026-06-04 23:00:22,520 - __main__ - INFO - Scraper rss completed: 4 results

2026-06-04 23:00:22,520 - __main__ - INFO - Scraper yiddish24 completed: 2 results

2026-06-04 23:00:22,520 - __main__ - INFO - Scraper ivelt completed: 6 results

2026-06-04 23:00:23,182 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-04 23:00:23.182909

2026-06-04 23:00:23,183 - __main__ - INFO - Email sent successfully

2026-06-04 23:00:23,183 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-04 23:00:23,183 - __main__ - INFO - Monitor complete. Found 12 total results: 4 new rss results, 2 new yiddish24 results, 6 new ivelt results.

2026-06-04 23:00:23,183 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-04 23:00:23,183 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-04 23:00:23,227 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-04 23:00:23,227 - __main__ - INFO - Closed all database connections

2026-06-04 23:00:23,229 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-04 23:00:23,229 - social_media_monitor.database.connection - INFO - Closed 0 database connections