← Logs

social_media_monitor_2026-07-25.log

2026-07-25 00:15:01,822 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-07-25.log

2026-07-25 00:15:01,822 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-07-25.log

2026-07-25 00:15:01,823 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-07-25.log

2026-07-25 00:15:01,823 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-07-25 00:15:01,855 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-07-25 00:15:01,855 - __main__ - INFO - Configuration loaded and validated successfully

2026-07-25 00:15:01,858 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-07-25 00:15:01,859 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-07-25 00:15:01,873 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-07-25 00:15:01,873 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-07-25 00:15:01,922 - social_media_monitor.scrapers.reddit_scraper - ERROR - Failed to initialize Reddit API: [Errno 28] No space left on device

2026-07-25 00:15:01,923 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-07-25 00:15:01,928 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-07-25 00:15:01,928 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-07-25 00:15:01,932 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-07-25 00:15:01,935 - __main__ - INFO - Gmail Downloads scraper initialized and enabled

2026-07-25 00:15:01,938 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-07-25 00:15:01,939 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-07-25 00:15:01,939 - __main__ - INFO - TorahAnytime scraper initialized and enabled

2026-07-25 00:15:01,942 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-07-25 00:15:01,942 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-07-25 00:15:01,942 - __main__ - INFO - Batorah scraper initialized and enabled

2026-07-25 00:15:01,942 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-07-25 00:15:01,945 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-07-25 00:15:01,945 - __main__ - INFO - Running 3 scrapers concurrently...

2026-07-25 00:15:01,946 - TorahAnytimeScraper - INFO - Starting TorahAnytime scraping (limit 400, max 100 items)

2026-07-25 00:15:02,048 - BatorahScraper - INFO - Starting Batorah scraping (2 APIs, page_size=100, max 100 items)

2026-07-25 00:15:02,052 - BatorahScraper - INFO - Fetching from: https://batorah.com/api/yi/latest-videos-three

2026-07-25 00:15:02,280 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully connected to Gmail IMAP: abeperl@gmail.com

2026-07-25 00:15:02,351 - social_media_monitor.scrapers.gmail_scraper - INFO - Found 26 emails with label: Z0TorahLinks

2026-07-25 00:15:03,043 - httpx - INFO - HTTP Request: GET https://batorah.com/api/yi/latest-videos-three?pagesize=100&pageno=1&time=1784938502052&followerId= "HTTP/1.1 200 OK"

2026-07-25 00:15:03,379 - BatorahScraper - INFO - Fetched 100 videos from https://batorah.com/api/yi/latest-videos-three

2026-07-25 00:15:04,378 - BatorahScraper - INFO - Fetching from: https://batorah.com/api/yi/category-home-slider-one

2026-07-25 00:15:04,381 - httpx - INFO - HTTP Request: GET https://api.torahanytime.com/lectures/latest-list?limit=400&offset=0&project_id=1 "HTTP/1.1 200 OK"

2026-07-25 00:15:04,520 - httpx - INFO - HTTP Request: GET https://batorah.com/api/yi/category-home-slider-one?no "HTTP/1.1 200 OK"

2026-07-25 00:15:04,522 - BatorahScraper - INFO - Fetched 10 videos from https://batorah.com/api/yi/category-home-slider-one

2026-07-25 00:15:04,523 - BatorahScraper - INFO - Total Batorah results found: 0

2026-07-25 00:15:04,547 - TorahAnytimeScraper - INFO - Fetched 400 lectures from API

2026-07-25 00:15:04,573 - TorahAnytimeScraper - INFO - Term 'Fischel Schachter' matched in SPEAKER: 'R' Fischel Schachter'

2026-07-25 00:15:04,573 - TorahAnytimeScraper - INFO - Found 2 media file(s) for lecture: Tisha Bav Kinnos 5786

2026-07-25 00:15:05,074 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ta-lectures.s3.us-east-005.backblazeb2.com/mp3/465324/465324-tip6h9.mp3

2026-07-25 00:15:05,143 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: AP Torah - 2026-07-24 18:16 (2026-07-24) from abeperl@gmail.com

2026-07-25 00:15:05,176 - social_media_monitor.utils.link_extractor - INFO - Extracted 64 links with context from email

2026-07-25 00:15:05,777 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://batorah.com/yi/video/64040

2026-07-25 00:15:06,313 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://batorah.com/yi/video/64038

2026-07-25 00:15:07,528 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465295

2026-07-25 00:15:08,351 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465292

2026-07-25 00:15:09,399 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465286

2026-07-25 00:15:10,187 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465281

2026-07-25 00:15:11,063 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465287

2026-07-25 00:15:11,951 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/464056

2026-07-25 00:15:12,765 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465285

2026-07-25 00:15:13,555 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465284

2026-07-25 00:15:14,114 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: TA_465324-tip6h9.mp3 (171.8 MB)

2026-07-25 00:15:14,116 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-07-25 00:15:14,195 - social_media_monitor.utils.media_tagger - INFO - Tagged TA_465324-tip6h9.mp3: title, artist, album, date, comment, source_url, genre, publisher

2026-07-25 00:15:14,195 - TorahAnytimeScraper - INFO - Skipping video download (audio already downloaded): https://ta-lectures.s3.us-east-005.backblazeb2.com/mp4/465324-tip6h9.mp4

2026-07-25 00:15:14,347 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465253

2026-07-25 00:15:14,354 - TorahAnytimeScraper - INFO - Term 'Charlie Harary' matched in SPEAKER: 'Mr. Charlie Harary'

2026-07-25 00:15:14,355 - TorahAnytimeScraper - INFO - Found 2 media file(s) for lecture: Project Inspire Tisha B'Av Radio Show

2026-07-25 00:15:14,855 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ta-lectures.s3.us-east-005.backblazeb2.com/mp3/465247/465247-tioonj.mp3

2026-07-25 00:15:15,120 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465257

2026-07-25 00:15:15,962 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465280

2026-07-25 00:15:16,732 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465275

2026-07-25 00:15:17,532 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465267

2026-07-25 00:15:18,370 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465244

2026-07-25 00:15:19,184 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465274

2026-07-25 00:15:19,964 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465273

2026-07-25 00:15:20,742 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465270

2026-07-25 00:15:21,290 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: TA_465247-tioonj.mp3 (132.0 MB)

2026-07-25 00:15:21,293 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-07-25 00:15:21,346 - social_media_monitor.utils.media_tagger - INFO - Tagged TA_465247-tioonj.mp3: title, artist, album, date, comment, source_url, genre, publisher

2026-07-25 00:15:21,346 - TorahAnytimeScraper - INFO - Skipping video download (audio already downloaded): https://ta-lectures.s3.us-east-005.backblazeb2.com/mp4/465247-tioonj.mp4

2026-07-25 00:15:21,473 - TorahAnytimeScraper - INFO - Term 'music' matched in SPEAKER: 'Music Anytime'

2026-07-25 00:15:21,473 - TorahAnytimeScraper - INFO - Found 1 media file(s) for lecture: Va’eschanan: Breakthrough

2026-07-25 00:15:21,502 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/463998

2026-07-25 00:15:21,973 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ta-lectures.s3.us-east-005.backblazeb2.com/mp3/465316/465316-tip1i3.mp3

2026-07-25 00:15:22,355 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465268

2026-07-25 00:15:22,712 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: TA_465316-tip1i3.mp3 (4.0 MB)

2026-07-25 00:15:22,714 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-07-25 00:15:22,717 - social_media_monitor.utils.media_tagger - INFO - Tagged TA_465316-tip1i3.mp3: title, artist, album, date, comment, source_url, genre, publisher

2026-07-25 00:15:23,158 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465251

2026-07-25 00:15:23,941 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465249

2026-07-25 00:15:24,763 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465256

2026-07-25 00:15:25,563 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465250

2026-07-25 00:15:25,699 - TorahAnytimeScraper - INFO - Total TorahAnytime results found: 23

2026-07-25 00:15:26,371 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465266

2026-07-25 00:15:27,198 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465258

2026-07-25 00:15:27,992 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465236

2026-07-25 00:15:28,770 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465264

2026-07-25 00:15:29,672 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465259

2026-07-25 00:15:30,497 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465260

2026-07-25 00:15:31,265 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465133

2026-07-25 00:15:32,058 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465252

2026-07-25 00:15:32,829 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465254

2026-07-25 00:15:33,599 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465245

2026-07-25 00:15:34,430 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465232

2026-07-25 00:15:35,306 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465238

2026-07-25 00:15:36,316 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465233

2026-07-25 00:15:37,135 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465220

2026-07-25 00:15:37,916 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465222

2026-07-25 00:15:38,739 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465105

2026-07-25 00:15:39,516 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465209

2026-07-25 00:15:40,365 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465207

2026-07-25 00:15:41,149 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465219

2026-07-25 00:15:41,944 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465216

2026-07-25 00:15:42,727 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465212

2026-07-25 00:15:43,505 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465208

2026-07-25 00:15:44,288 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465210

2026-07-25 00:15:45,070 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465203

2026-07-25 00:15:45,850 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465201

2026-07-25 00:15:46,600 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/464843

2026-07-25 00:15:47,372 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465200

2026-07-25 00:15:48,176 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465198

2026-07-25 00:15:48,952 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465278

2026-07-25 00:15:49,720 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465294

2026-07-25 00:15:50,506 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465242

2026-07-25 00:15:51,303 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465261

2026-07-25 00:15:52,116 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465239

2026-07-25 00:15:52,912 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465243

2026-07-25 00:15:53,686 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465240

2026-07-25 00:15:54,638 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465213

2026-07-25 00:15:55,424 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465202

2026-07-25 00:15:55,433 - social_media_monitor.scrapers.gmail_scraper - INFO - URL already downloaded, skipping: https://files.ichudtosh.org/DBK%20Rush%20Choidesh%20Uv%2086.mp3

2026-07-25 00:15:55,439 - social_media_monitor.scrapers.gmail_scraper - INFO - URL already downloaded, skipping: https://files.ichudtosh.org/Rabbi%20Mordche%20Mertz%20Vuaschunen.mp3

2026-07-25 00:15:55,448 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: AP Torah - 2026-07-24 18:16

2026-07-25 00:15:55,727 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 24

2026-07-25 00:15:55,757 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 24

2026-07-25 00:15:55,757 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: AP Torah - 2026-07-24 18:16

2026-07-25 00:15:55,789 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: New Lecture by Rabbi Shlomie Ehrlich - Tisha B' Av: Can Yiddish podcasts be dangerous? (2026-07-24) from TorahAnytime Following <following@torahanytime.com>

2026-07-25 00:15:55,797 - social_media_monitor.utils.link_extractor - INFO - Extracted 2 links with context from email

2026-07-25 00:15:57,282 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/465276

2026-07-25 00:15:58,813 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.charidy.com/TorahAnytime9av?utm_source=Following_Emails&utm_medium=Email&utm_campaign=following_emails

2026-07-25 00:15:58,841 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: New Lecture by Rabbi Shlomie Ehrlich - Tisha B' Av: Can Yiddish podcasts be dangerous?

2026-07-25 00:15:59,101 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 25

2026-07-25 00:15:59,143 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 25

2026-07-25 00:15:59,143 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: New Lecture by Rabbi Shlomie Ehrlich - Tisha B' Av: Can Yiddish podcasts be dangerous?

2026-07-25 00:15:59,238 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: Revised: דברי תורה וויען - דברים - תשפ''ו - בקעמפ מתיבתא נחלת יעקב - לאק שעלדריק (2026-07-24) from מכון מעדני מלך וויען <mechonmmvien@gmail.com>

2026-07-25 00:15:59,243 - social_media_monitor.scrapers.gmail_scraper - INFO - Skipping PDF attachment: דברי תורה וויען - דברים - תשפ''ו - בקעמפ מתיבתא נחלת יעקב - לאק שעלדריק.pdf

2026-07-25 00:15:59,243 - social_media_monitor.scrapers.gmail_scraper - INFO - Email has attachments, skipping link extraction for: Revised: דברי תורה וויען - דברים - תשפ''ו - בקעמפ מתיבתא נחלת יעקב - לאק שעלדריק

2026-07-25 00:15:59,253 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: Revised: דברי תורה וויען - דברים - תשפ''ו - בקעמפ מתיבתא נחלת יעקב - לאק שעלדריק

2026-07-25 00:15:59,503 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 26

2026-07-25 00:15:59,530 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 26

2026-07-25 00:15:59,530 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: Revised: דברי תורה וויען - דברים - תשפ''ו - בקעמפ מתיבתא נחלת יעקב - לאק שעלדריק

2026-07-25 00:15:59,530 - social_media_monitor.scrapers.gmail_scraper - INFO - Processed 26 emails, 67 downloads

2026-07-25 00:15:59,536 - social_media_monitor.scrapers.gmail_scraper - INFO - Disconnected from Gmail IMAP

2026-07-25 00:15:59,541 - __main__ - INFO - Scraper gmail completed: 67 results

2026-07-25 00:15:59,541 - __main__ - INFO - Scraper torahanytime completed: 23 results

2026-07-25 00:15:59,541 - __main__ - INFO - Scraper batorah completed: 0 results

2026-07-25 00:16:00,177 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-07-25 00:16:00.177376

2026-07-25 00:16:00,177 - __main__ - INFO - Email sent successfully

2026-07-25 00:16:00,178 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-07-25 00:16:00,178 - __main__ - INFO - Monitor complete. Found 90 total results: 23 new torahanytime results, 67 new gmail downloads.

2026-07-25 00:16:00,178 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-07-25 00:16:00,179 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-07-25 00:16:00,336 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-07-25 00:16:00,336 - __main__ - INFO - Closed all database connections

2026-07-25 00:16:00,340 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-07-25 00:16:00,340 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-07-25 00:45:02,519 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-07-25.log

2026-07-25 00:45:02,519 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-07-25.log

2026-07-25 00:45:02,519 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-07-25.log

2026-07-25 00:45:02,519 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-07-25 00:45:02,552 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-07-25 00:45:02,552 - __main__ - INFO - Configuration loaded and validated successfully

2026-07-25 00:45:02,554 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-07-25 00:45:02,555 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-07-25 00:45:02,577 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-07-25 00:45:02,577 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-07-25 00:45:02,622 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-07-25 00:45:02,623 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-07-25 00:45:02,627 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-07-25 00:45:02,627 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-07-25 00:45:02,630 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-07-25 00:45:02,637 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-07-25 00:45:02,637 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-07-25 00:45:02,641 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-07-25 00:45:02,641 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-07-25 00:45:02,641 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-07-25 00:45:02,646 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-07-25 00:45:02,646 - __main__ - WARNING - No scrapers enabled or available

2026-07-25 00:45:02,646 - __main__ - INFO - run_id 7 (AhBlick): email sending skipped by configuration.

2026-07-25 00:45:02,646 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-07-25 00:45:02,646 - __main__ - INFO - Monitor complete. No new results found across all sources.

2026-07-25 00:45:02,647 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-07-25 00:45:02,647 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-07-25 00:45:02,658 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-07-25 00:45:02,659 - __main__ - INFO - Closed all database connections

2026-07-25 00:45:02,660 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-07-25 00:45:02,660 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-07-25 03:00:02,375 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-07-25.log

2026-07-25 03:00:02,375 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-07-25.log

2026-07-25 03:00:02,375 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-07-25.log

2026-07-25 03:00:02,375 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-07-25 03:00:02,405 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-07-25 03:00:02,405 - __main__ - INFO - Configuration loaded and validated successfully

2026-07-25 03:00:02,407 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-07-25 03:00:02,408 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-07-25 03:00:02,552 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-07-25 03:00:02,553 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-07-25 03:00:02,604 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-07-25 03:00:02,606 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-07-25 03:00:02,615 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-07-25 03:00:02,615 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-07-25 03:00:02,622 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-07-25 03:00:02,631 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-07-25 03:00:02,632 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-07-25 03:00:02,636 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-07-25 03:00:02,636 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-07-25 03:00:02,636 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-07-25 03:00:02,636 - __main__ - INFO - Kol Halashon scraper initialized and enabled

2026-07-25 03:00:02,638 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-07-25 03:00:02,638 - __main__ - INFO - All Daf scraper initialized and enabled

2026-07-25 03:00:02,638 - __main__ - INFO - Running 2 scrapers concurrently...

2026-07-25 03:00:02,639 - KolHalashonScraper - INFO - Starting Kol Halashon scraping

2026-07-25 03:00:02,720 - KolHalashonScraper - INFO - Found current parsha: Eikev (עקב)

2026-07-25 03:00:02,720 - KolHalashonScraper - INFO - Using parsha URL template (id=1): https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?u...

2026-07-25 03:00:02,720 - KolHalashonScraper - INFO - Parsha raw URL template: https://www2.kolhalashon.com/regularSite/searchResults/1/{parshaid}/{parshaen}?urlFilters=3:3%7C{speakersfilter}

2026-07-25 03:00:02,726 - KolHalashonScraper - INFO - Speaker IDs for URL id=1: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-07-25 03:00:02,726 - KolHalashonScraper - INFO - Parsha speaker filter string: [7098, 999121, 952143, 7651, 985996, 7643, 7124, 934613, 2393, 7031]

2026-07-25 03:00:02,726 - KolHalashonScraper - INFO - Parsha encoded speaker filter: 2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-07-25 03:00:02,726 - KolHalashonScraper - INFO - Parsha processed URL: https://www2.kolhalashon.com/regularSite/searchResults/1/46/Eikev?urlFilters=3:3%7C2:7098%7C2:999121%7C2:952143%7C2:7651%7C2:985996%7C2:7643%7C2:7124%7C2:934613%7C2:2393%7C2:7031%7C

2026-07-25 03:00:02,726 - KolHalashonScraper - INFO - Current parsha: Eikev (עקב)

2026-07-25 03:00:02,727 - KolHalashonScraper - INFO - Processing parsha URL (id=1)

2026-07-25 03:00:02,727 - KolHalashonScraper - INFO - Processing 3 total URLs (1 parsha + 2 search)

2026-07-25 03:00:02,727 - KolHalashonScraper - INFO - Replacing parsha placeholders with id=46, name=Eikev, in_humash=3

2026-07-25 03:00:02,730 - KolHalashonScraper - WARNING - No daf schedule found for today - cannot replace daf placeholders

2026-07-25 03:00:02,730 - KolHalashonScraper - INFO - Scraping all 2 URLs with unified method...

2026-07-25 03:00:02,731 - KolHalashonScraper - INFO - Starting multi-URL browser scrape with 2 URLs, max 10 pages per URL (download_inline=True)

2026-07-25 03:00:02,764 - KolHalashonScraper - INFO - Detected installed Chrome major version 149 from '/usr/bin/google-chrome' (output: 'Google Chrome 149.0.7827.155')

2026-07-25 03:00:02,764 - KolHalashonScraper - INFO - Pinning undetected-chromedriver version_main=149 to detected installed Chrome major version

2026-07-25 03:00:02,764 - KolHalashonScraper - INFO - Running browser in headless mode

2026-07-25 03:00:02,764 - KolHalashonScraper - INFO - Browser download directory set to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-07-25 03:00:02,764 - KolHalashonScraper - INFO - Using undetected-chromedriver for Cloudflare bypass (attempt 1/3)

2026-07-25 03:00:02,830 - KolHalashonScraper - ERROR - Browser initialization failed (attempt 1/3): FileNotFoundError: [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/openclaw/Social_Media_Monitor']

2026-07-25 03:00:02,830 - KolHalashonScraper - INFO - Waiting 5s before retry...

2026-07-25 03:00:02,897 - KolHalashonScraper - INFO - Chrome process count before cleanup: 86

2026-07-25 03:00:04,898 - KolHalashonScraper - INFO - Cleanup completed

2026-07-25 03:00:09,898 - KolHalashonScraper - INFO - Running browser in headless mode

2026-07-25 03:00:09,898 - KolHalashonScraper - INFO - Browser download directory set to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-07-25 03:00:09,899 - KolHalashonScraper - INFO - Using undetected-chromedriver for Cloudflare bypass (attempt 2/3)

2026-07-25 03:00:09,950 - KolHalashonScraper - ERROR - Browser initialization failed (attempt 2/3): FileNotFoundError: [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/openclaw/Social_Media_Monitor']

2026-07-25 03:00:09,950 - KolHalashonScraper - INFO - Waiting 15s before retry...

2026-07-25 03:00:09,992 - KolHalashonScraper - INFO - Chrome process count before cleanup: 86

2026-07-25 03:00:11,992 - KolHalashonScraper - INFO - Cleanup completed

2026-07-25 03:00:26,993 - KolHalashonScraper - INFO - Running browser in headless mode

2026-07-25 03:00:26,993 - KolHalashonScraper - INFO - Browser download directory set to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-07-25 03:00:26,993 - KolHalashonScraper - INFO - Using undetected-chromedriver for Cloudflare bypass (attempt 3/3)

2026-07-25 03:00:27,046 - KolHalashonScraper - ERROR - Browser initialization failed (attempt 3/3): FileNotFoundError: [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/openclaw/Social_Media_Monitor']

2026-07-25 03:00:27,046 - KolHalashonScraper - ERROR - Browser initialization failed after 3 attempts

2026-07-25 03:00:27,046 - KolHalashonScraper - ERROR - Browser scraping failed: [Errno 2] No usable temporary directory found in ['/tmp', '/var/tmp', '/usr/tmp', '/home/openclaw/Social_Media_Monitor']

2026-07-25 03:00:27,053 - KolHalashonScraper - INFO - Multi-URL scrape complete: 0 new shiurim from 0 URLs (0 total pages), 0 total checked

2026-07-25 03:00:27,057 - social_media_monitor.scrapers.kolhalashon_scraper - INFO - Shiurim sync complete: 0 new, 0 already in db, 1822 total

2026-07-25 03:00:27,057 - KolHalashonScraper - INFO - Parsha shiurim: 0 new, 0 match filter, 0 total

2026-07-25 03:00:27,058 - KolHalashonScraper - INFO - Kol Halashon scraping complete: 0 NEW shiurim for email, 0 total new, 0 match filter (all)

2026-07-25 03:00:27,058 - AllDafScraper - WARNING - All Daf: no daf row found in kolhalashon_daf_schedule for 1-day range

2026-07-25 03:00:27,058 - AllDafScraper - ERROR - All Daf: no daf rows found in kolhalashon_daf_schedule for this run

2026-07-25 03:00:27,058 - __main__ - INFO - Scraper kolhalashon completed: 0 results

2026-07-25 03:00:27,058 - __main__ - INFO - Scraper alldaf completed: 0 results

2026-07-25 03:00:27,059 - __main__ - INFO - No content to send in email

2026-07-25 03:00:27,059 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-07-25 03:00:27,059 - __main__ - INFO - Monitor complete. No new results found across all sources.

2026-07-25 03:00:27,059 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-07-25 03:00:27,059 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-07-25 03:00:27,074 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-07-25 03:00:27,074 - __main__ - INFO - Closed all database connections

2026-07-25 03:00:27,075 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-07-25 03:00:27,075 - social_media_monitor.database.connection - INFO - Closed 0 database connections