โ† Logs

social_media_monitor_2026-06-03.log

2026-06-03 18:45:07,652 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ahblicklive.com/new_ded_video/26/23/8VO16eQ5rfqxcSYFmSB/hQzZO0/hQzZO0.mp4
2026-06-03 18:45:08,384 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: BL_hQzZO0.mp4 (16.4 MB)
2026-06-03 18:45:08,386 - social_media_monitor.utils.file_downloader - INFO - Organized video file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Video (video/mp4)
2026-06-03 18:45:08,404 - social_media_monitor.utils.media_tagger - INFO - Tagged BL_hQzZO0.mp4: title, album, comment, genre
2026-06-03 18:45:08,430 - AhBlickLiveScraper - INFO - Total AhBlickLive results: 4
2026-06-03 18:45:08,431 - __main__ - INFO - Scraper ahblicklive completed: 4 results
2026-06-03 18:45:08,999 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-03 18:45:08.999728
2026-06-03 18:45:09,000 - __main__ - INFO - Email sent successfully
2026-06-03 18:45:09,000 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-03 18:45:09,000 - __main__ - INFO - Monitor complete. Found 4 total results: 4 new ahblicklive results.
2026-06-03 18:45:09,000 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-03 18:45:09,000 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 18:45:09,012 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-03 18:45:09,012 - __main__ - INFO - Closed all database connections
2026-06-03 18:45:09,015 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 18:45:09,016 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-03 19:00:01,850 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-03.log
2026-06-03 19:00:01,850 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-03.log
2026-06-03 19:00:01,850 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-03.log
2026-06-03 19:00:01,850 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-03 19:00:01,883 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-03 19:00:01,883 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-03 19:00:01,885 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-03 19:00:01,886 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-03 19:00:01,906 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-03 19:00:01,906 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-03 19:00:01,907 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-03 19:00:01,908 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-06-03 19:00:01,908 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-03 19:00:01,911 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-06-03 19:00:01,911 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-06-03 19:00:01,911 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-03 19:00:01,913 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-06-03 19:00:01,918 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-06-03 19:00:01,918 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-06-03 19:00:01,920 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-03 19:00:01,920 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-03 19:00:01,920 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-03 19:00:01,920 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-03 19:00:01,920 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-03 19:00:01,921 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-03 19:00:02,005 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-03 19:00:02,010 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-03 19:00:02,010 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-03 19:00:02,011 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-03 19:00:02,690 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-03 19:00:03,687 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-06-03 19:00:08,873 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-03 19:00:09,052 - Yiddish24Scraper - INFO - Received response with 468199 characters
2026-06-03 19:00:09,055 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (295405 chars)
2026-06-03 19:00:09,058 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-03 19:00:09,143 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-03 19:00:09,182 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-03 19:00:09,182 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-03 19:00:09,192 - Yiddish24Scraper - INFO - Term 'ื”ื›ืœ ื‘ื›ืœ' matched in TITLE: 'ื”ื›ืœ ื‘ื›ืœ'
2026-06-03 19:00:09,192 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-06-03 19:00:09,964 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_________%27___________________260_260603013549.mp3
2026-06-03 19:00:11,987 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2__________'___________________260_260603013549.mp3 (42.6 MB)
2026-06-03 19:00:11,989 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-03 19:00:12,023 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2__________'___________________260_260603013549.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-03 19:00:12,055 - Yiddish24Scraper - INFO - Term 'ืื™ื™ื–ื™ืง ืœื™ื™ื‘ ืžื™ืœืœืขืจ' matched in DESCRIPTION: 'ื”ืจื‘ ืื™ื™ื–ื™ืง ืœื™ื™ื‘ ืžื™ืœืœืขืจ, ืื•ื™ืคืŸ ืกืฆืขื ืข'
2026-06-03 19:00:12,055 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: ืื™ื™ื’ืขื ืืจื˜ื™ื’ืขืจ ืคืืจืžืื›ื˜ืข ืงืื ืคืจืขื ืก ืื™ืŸ ื“ื™
2026-06-03 19:00:12,556 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_49_1780512144.mp3
2026-06-03 19:00:12,666 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_49_1780512144.mp3 (2.1 MB)
2026-06-03 19:00:12,668 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-03 19:00:12,673 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_49_1780512144.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-03 19:00:12,985 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in DESCRIPTION: 'ื”ืจื‘ ืžื˜ื•ืช ื•ื•ืืœืคื‘ืขืจื’'
2026-06-03 19:00:12,985 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: ื ื™ื• ื™ืืจืง ืกื™ื˜ื™ ื•ื•ืขื˜ ืื™ื ืกื˜ืืœื™ืจืŸ ืกืขื ืกืขืจืก
2026-06-03 19:00:13,556 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_48_1780512117.mp3
2026-06-03 19:00:14,401 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_48_1780512117.mp3 (732.5 KB)
2026-06-03 19:00:14,402 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-03 19:00:14,405 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_48_1780512117.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-03 19:00:15,055 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 100 total articles
2026-06-03 19:00:15,056 - Yiddish24Scraper - INFO - Page 1: 10/100 new items
2026-06-03 19:00:15,056 - Yiddish24Scraper - INFO - Low new item ratio (10.0%), stopping pagination
2026-06-03 19:00:15,056 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10
2026-06-03 19:00:15,064 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-03 19:00:49,302 - IveltScraper - INFO - Ivelt scrape complete. Checked 6 topics, found 35 new posts.
2026-06-03 19:00:49,302 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-03 19:00:49,303 - __main__ - INFO - Scraper yiddish24 completed: 10 results
2026-06-03 19:00:49,303 - __main__ - INFO - Scraper ivelt completed: 35 results
2026-06-03 19:00:50,158 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-03 19:00:50.158260
2026-06-03 19:00:50,158 - __main__ - INFO - Email sent successfully
2026-06-03 19:00:50,159 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-03 19:00:50,159 - __main__ - INFO - Monitor complete. Found 49 total results: 4 new rss results, 10 new yiddish24 results, 35 new ivelt results.
2026-06-03 19:00:50,159 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-03 19:00:50,159 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 19:00:50,217 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-03 19:00:50,217 - __main__ - INFO - Closed all database connections
2026-06-03 19:00:50,220 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 19:00:50,220 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-03 20:00:01,825 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-03.log
2026-06-03 20:00:01,825 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-03.log
2026-06-03 20:00:01,825 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-03.log
2026-06-03 20:00:01,825 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-03 20:00:01,872 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-03 20:00:01,872 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-03 20:00:01,875 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-03 20:00:01,876 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-03 20:00:01,899 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-03 20:00:01,899 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-03 20:00:01,947 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-03 20:00:01,948 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-06-03 20:00:01,948 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-03 20:00:01,951 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-06-03 20:00:01,951 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-06-03 20:00:01,951 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-03 20:00:01,953 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-06-03 20:00:01,957 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-06-03 20:00:01,957 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-06-03 20:00:01,959 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-03 20:00:01,959 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-03 20:00:01,960 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-03 20:00:01,960 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-03 20:00:01,960 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-03 20:00:01,960 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-03 20:00:02,065 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-03 20:00:02,070 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-03 20:00:02,070 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-03 20:00:02,072 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-03 20:00:02,658 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-03 20:00:03,187 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-03 20:00:08,567 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-03 20:00:08,744 - Yiddish24Scraper - INFO - Received response with 477369 characters
2026-06-03 20:00:08,747 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301452 chars)
2026-06-03 20:00:08,750 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-03 20:00:08,840 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-03 20:00:08,880 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-03 20:00:08,881 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-03 20:00:08,891 - Yiddish24Scraper - INFO - Term 'ื”ื›ืœ ื‘ื›ืœ' matched in TITLE: 'ื”ื›ืœ ื‘ื›ืœ'
2026-06-03 20:00:08,891 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-06-03 20:00:09,649 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/HaPeleg_Hayrushalmi__260_260603014104.mp3
2026-06-03 20:00:10,880 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_HaPeleg_Hayrushalmi__260_260603014104.mp3 (8.0 MB)
2026-06-03 20:00:10,881 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-03 20:00:10,903 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_HaPeleg_Hayrushalmi__260_260603014104.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-03 20:00:10,904 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_HaPeleg_Hayrushalmi__260_260603014104_ื”ื›ืœ_ื‘ื›ืœ.mp3
2026-06-03 20:00:11,238 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in TITLE: 'ืจืฉื•ืช ื”ืจื‘ื™ื'
2026-06-03 20:00:11,238 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืจืฉื•ืช ื”ืจื‘ื™ื
2026-06-03 20:00:11,738 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/332_7187576234_06032026_154223_302_260603035021.wav
2026-06-03 20:00:12,736 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_332_7187576234_06032026_154223_302_260603035021.wav (1.6 MB)
2026-06-03 20:00:12,737 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/x-wav)
2026-06-03 20:00:12,737 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_332_7187576234_06032026_154223_302_260603035021_ื”ืจื‘.wav
2026-06-03 20:00:12,751 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in TITLE: 'ืจืฉื•ืช ื”ืจื‘ื™ื'
2026-06-03 20:00:12,751 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืจืฉื•ืช ื”ืจื‘ื™ื
2026-06-03 20:00:13,251 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/332_7184352740_06032026_153035_302_260603034100.wav
2026-06-03 20:00:13,425 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_332_7184352740_06032026_153035_302_260603034100.wav (4.1 MB)
2026-06-03 20:00:13,425 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/x-wav)
2026-06-03 20:00:13,425 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_332_7184352740_06032026_153035_302_260603034100_ื”ืจื‘.wav
2026-06-03 20:00:13,438 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in TITLE: 'ืจืฉื•ืช ื”ืจื‘ื™ื'
2026-06-03 20:00:13,439 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืจืฉื•ืช ื”ืจื‘ื™ื
2026-06-03 20:00:14,251 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/332_8455452930_06032026_150804_302_260603033218.wav
2026-06-03 20:00:14,299 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_332_8455452930_06032026_150804_302_260603033218.wav (948.0 KB)
2026-06-03 20:00:14,299 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/x-wav)
2026-06-03 20:00:14,300 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_332_8455452930_06032026_150804_302_260603033218_ื”ืจื‘.wav
2026-06-03 20:00:14,312 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in TITLE: 'ืจืฉื•ืช ื”ืจื‘ื™ื'
2026-06-03 20:00:14,312 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืจืฉื•ืช ื”ืจื‘ื™ื
2026-06-03 20:00:15,252 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/AUDIO20260603152757_302_260603033154.mp3
2026-06-03 20:00:15,402 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_AUDIO20260603152757_302_260603033154.mp3 (4.1 MB)
2026-06-03 20:00:15,403 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-03 20:00:15,410 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_AUDIO20260603152757_302_260603033154.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-03 20:00:15,410 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_AUDIO20260603152757_302_260603033154_ื”ืจื‘.mp3
2026-06-03 20:00:16,057 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 100 total articles
2026-06-03 20:00:16,057 - Yiddish24Scraper - INFO - Page 1: 10/100 new items
2026-06-03 20:00:16,057 - Yiddish24Scraper - INFO - Low new item ratio (10.0%), stopping pagination
2026-06-03 20:00:16,058 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10
2026-06-03 20:00:16,066 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-03 20:00:53,024 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 24 new posts.
2026-06-03 20:00:53,024 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-03 20:00:53,025 - __main__ - INFO - Scraper yiddish24 completed: 10 results
2026-06-03 20:00:53,025 - __main__ - INFO - Scraper ivelt completed: 24 results
2026-06-03 20:00:53,751 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-03 20:00:53.751620
2026-06-03 20:00:53,752 - __main__ - INFO - Email sent successfully
2026-06-03 20:00:53,752 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-03 20:00:53,752 - __main__ - INFO - Monitor complete. Found 37 total results: 3 new rss results, 10 new yiddish24 results, 24 new ivelt results.
2026-06-03 20:00:53,752 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-03 20:00:53,752 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 20:00:53,879 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-03 20:00:53,880 - __main__ - INFO - Closed all database connections
2026-06-03 20:00:53,882 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 20:00:53,882 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-03 20:30:02,108 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-03.log
2026-06-03 20:30:02,108 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-03.log
2026-06-03 20:30:02,109 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-03.log
2026-06-03 20:30:02,109 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-03 20:30:02,141 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-03 20:30:02,141 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-03 20:30:02,142 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-03 20:30:02,144 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-03 20:30:02,157 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-03 20:30:02,168 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-03 20:30:02,168 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-03 20:30:02,169 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-03 20:30:02,169 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-03 20:30:02,169 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-03 20:30:02,169 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-03 20:30:02,170 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-03 20:30:02,171 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-03 20:30:02,171 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-03 20:30:02,173 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-06-03 20:30:02,173 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-06-03 20:30:02,176 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-03 20:30:02,181 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-06-03 20:30:02,181 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-06-03 20:30:02,184 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-03 20:30:02,184 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-03 20:30:02,184 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-03 20:30:02,185 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-03 20:30:02,185 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-03 20:30:02,185 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-03 20:30:02,994 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-03 20:30:03,181 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: We had Hermes, OpenClaw, Claude Code and Codex collaborate on the same
2026-06-03 20:30:03,195 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Is there any "moltbook" for Hermes agents?
2026-06-03 20:30:03,222 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: NEW Hermes Agent OS Just Changed AI Forever!
2026-06-03 20:30:03,238 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Big Model Value Wars - DeepSeek V4 Pro vs MiMo-V2.5-Pro vs MiniMax M3
2026-06-03 20:30:03,257 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Switching from ChatGPT to Hermes Agent?
2026-06-03 20:30:03,272 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent memory tip: Reddit growth workflow without the stale cont
2026-06-03 20:30:04,429 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 6
2026-06-03 20:30:04,429 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-03 20:30:04,430 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-03 20:30:04,430 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-03 20:30:06,380 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-06-03 20:30:06,413 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: T14 Gen 3 (i5-1245U) dual-boot nightmare: Fedora breaks UEFI on every
2026-06-03 20:30:07,649 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-06-03 20:30:07,650 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-03 20:30:07,650 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-03 20:30:07,650 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-03 20:30:08,471 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-06-03 20:30:09,695 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-03 20:30:09,696 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-03 20:30:09,696 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-03 20:30:09,696 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-03 20:30:11,105 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/Agent_AI: What do yโ€™all think of the Folk agent from Nozomio?
2026-06-03 20:30:11,114 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/mcp: KRONVOX give your AI agent a real (virtual) Android phone it can use o
2026-06-03 20:30:11,122 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Hermes Obsidian Is INSANE: Free AI Agent Upgrade
2026-06-03 20:30:11,151 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/Monero: Monero top payment method for a year straight on NanoGPT
2026-06-03 20:30:11,184 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/devops: Any native Harness templates for OpenClaw or Hermes yet?
2026-06-03 20:30:12,277 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-03 20:30:13,207 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Hermes Desktop AI Just Changed Everything!
2026-06-03 20:30:13,217 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ICBGC: Hermes update: meowmy dum
2026-06-03 20:30:14,313 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-03 20:30:16,749 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-03 20:30:18,996 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-03 20:30:18,996 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-03 20:30:21,543 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-03 20:30:23,687 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-03 20:30:25,665 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-03 20:30:25,665 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-03 20:30:27,708 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 7
2026-06-03 20:30:27,709 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-03 20:30:27,840 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-03 20:30:28,314 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-03 20:30:43,324 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-03 20:30:58,564 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-06-03 20:31:13,292 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-03 20:31:13,293 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-03 20:31:13,925 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-03 20:31:15,323 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-03 20:31:15,642 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent + Gemma4 in whatsapp!!! I think I just created my 1st emp
2026-06-03 20:31:15,928 - LinkedInScraper - INFO - New LinkedIn post: Anuj Paroha - B.Tech AIMl @ SIT Pune | AI and Automation Architect, Da
2026-06-03 20:31:15,971 - LinkedInScraper - INFO - New LinkedIn post: Mauro Bueno - AI Systems Architect & Technical Founder | Multi-Agent S
2026-06-03 20:31:15,994 - LinkedInScraper - INFO - New LinkedIn post: Karan Ahuja - Hermes & OpenClaw Hosting | Voice Calling AI - LinkedIn
2026-06-03 20:31:16,003 - LinkedInScraper - INFO - New LinkedIn post: Maksim Bober - Senior Software Engineer (Data Platforms) | Python, Spa
2026-06-03 20:31:16,492 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-03 20:31:16,829 - LinkedInScraper - INFO - New LinkedIn post: I wonder how many warm bodied(human!) developers stick to all or even
2026-06-03 20:31:17,179 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 6 new results.
2026-06-03 20:31:17,180 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-03 20:31:23,388 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-03 20:31:23,412 - GitHubScraper - INFO - Found 235 GitHub repositories for term: paperclip
2026-06-03 20:31:24,595 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-03 20:31:24,598 - GitHubScraper - INFO - Found 320 GitHub repositories for term: "Hermes Agent"
2026-06-03 20:31:25,810 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-03 20:31:25,813 - GitHubScraper - INFO - Found 47 GitHub repositories for term: multica
2026-06-03 20:31:25,957 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-03 20:31:25,957 - __main__ - INFO - Scraper reddit completed: 14 results
2026-06-03 20:31:25,958 - __main__ - INFO - Scraper github completed: 0 results
2026-06-03 20:31:25,958 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-03 20:31:25,958 - __main__ - INFO - Scraper linkedin completed: 6 results
2026-06-03 20:31:25,958 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-03 20:31:26,638 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-03 20:31:26.638142
2026-06-03 20:31:26,638 - __main__ - INFO - Email sent successfully
2026-06-03 20:31:26,638 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-03 20:31:26,638 - __main__ - INFO - Monitor complete. Found 20 total results: 14 new reddit results, 6 new linkedin results.
2026-06-03 20:31:26,638 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-03 20:31:26,639 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 20:31:26,802 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-03 20:31:26,802 - __main__ - INFO - Closed all database connections
2026-06-03 20:31:26,841 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 20:31:26,855 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-03 21:00:01,730 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-03.log
2026-06-03 21:00:01,730 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-03.log
2026-06-03 21:00:01,730 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-03.log
2026-06-03 21:00:01,730 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-03 21:00:01,765 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-03 21:00:01,765 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-03 21:00:01,769 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-03 21:00:01,769 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-03 21:00:02,018 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-03 21:00:02,019 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-03 21:00:02,065 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-03 21:00:02,066 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-03 21:00:02,066 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-03 21:00:02,069 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-06-03 21:00:02,069 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-06-03 21:00:02,069 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-03 21:00:02,073 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-03 21:00:02,080 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-06-03 21:00:02,080 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-06-03 21:00:02,083 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-03 21:00:02,083 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-03 21:00:02,084 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-03 21:00:02,084 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-03 21:00:02,084 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-03 21:00:02,084 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-03 21:00:02,178 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-03 21:00:02,183 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-03 21:00:02,183 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-03 21:00:02,184 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-03 21:00:02,799 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-03 21:00:03,329 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-03 21:00:12,865 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-03 21:00:13,043 - Yiddish24Scraper - INFO - Received response with 465764 characters
2026-06-03 21:00:13,048 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (296001 chars)
2026-06-03 21:00:13,052 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-03 21:00:13,131 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-03 21:00:13,177 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-03 21:00:13,177 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-03 21:00:13,186 - Yiddish24Scraper - INFO - Term 'ื”ื›ืœ ื‘ื›ืœ' matched in TITLE: 'ื”ื›ืœ ื‘ื›ืœ'
2026-06-03 21:00:13,186 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-06-03 21:00:13,993 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/YOILISH_260_260603014817.mp3
2026-06-03 21:00:15,083 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_YOILISH_260_260603014817.mp3 (4.6 MB)
2026-06-03 21:00:15,084 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-03 21:00:15,100 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_YOILISH_260_260603014817.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-03 21:00:15,101 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_YOILISH_260_260603014817_ื”ื›ืœ_ื‘ื›ืœ.mp3
2026-06-03 21:00:15,113 - Yiddish24Scraper - INFO - Term 'ื”ื›ืœ ื‘ื›ืœ' matched in TITLE: 'ื”ื›ืœ ื‘ื›ืœ'
2026-06-03 21:00:15,113 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-06-03 21:00:15,613 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/FARSHIDENS_braun_260_260603045919.mp3
2026-06-03 21:00:17,103 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_FARSHIDENS_braun_260_260603045919.mp3 (22.8 MB)
2026-06-03 21:00:17,104 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-03 21:00:17,126 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_FARSHIDENS_braun_260_260603045919.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-03 21:00:17,126 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_FARSHIDENS_braun_260_260603045919_ื”ื›ืœ_ื‘ื›ืœ.mp3
2026-06-03 21:00:17,136 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in DESCRIPTION: 'ื”ืจื‘ ื ืชืŸ ืจืื–ืขื ื‘ืœืื˜'
2026-06-03 21:00:17,136 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: ื’ื–ื™ืจื•ืช ื”ื’ื™ื•ืก ื‘ืชืงืคื•: ืฉื˜ื•ืจืขืžื™ืฉืข ื”ืคื’ื ื•ืช ืค
2026-06-03 21:00:17,636 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_51_1780519087.mp3
2026-06-03 21:00:17,685 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_51_1780519087.mp3 (1.1 MB)
2026-06-03 21:00:17,686 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-03 21:00:17,689 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_51_1780519087.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-03 21:00:17,690 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_51_1780519087_ื”ืจื‘.mp3
2026-06-03 21:00:17,702 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in TITLE: 'ืจืฉื•ืช ื”ืจื‘ื™ื'
2026-06-03 21:00:17,702 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืจืฉื•ืช ื”ืจื‘ื™ื
2026-06-03 21:00:18,636 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/AUDIO20260603160301_302_260603042126.mp3
2026-06-03 21:00:18,722 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_AUDIO20260603160301_302_260603042126.mp3 (1.3 MB)
2026-06-03 21:00:18,722 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-03 21:00:18,724 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_AUDIO20260603160301_302_260603042126.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-03 21:00:18,724 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_AUDIO20260603160301_302_260603042126_ื”ืจื‘.mp3
2026-06-03 21:00:19,678 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 100 total articles
2026-06-03 21:00:19,678 - Yiddish24Scraper - INFO - Page 1: 4/100 new items
2026-06-03 21:00:19,678 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination
2026-06-03 21:00:19,679 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4
2026-06-03 21:00:19,687 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-03 21:00:43,250 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 26 new posts.
2026-06-03 21:00:43,250 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-03 21:00:43,251 - __main__ - INFO - Scraper yiddish24 completed: 4 results
2026-06-03 21:00:43,251 - __main__ - INFO - Scraper ivelt completed: 26 results
2026-06-03 21:00:43,958 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-03 21:00:43.958762
2026-06-03 21:00:43,959 - __main__ - INFO - Email sent successfully
2026-06-03 21:00:43,959 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-03 21:00:43,959 - __main__ - INFO - Monitor complete. Found 33 total results: 3 new rss results, 4 new yiddish24 results, 26 new ivelt results.
2026-06-03 21:00:43,959 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-03 21:00:43,959 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 21:00:44,196 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-03 21:00:44,197 - __main__ - INFO - Closed all database connections
2026-06-03 21:00:44,199 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 21:00:44,199 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-03 22:00:02,317 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-03.log
2026-06-03 22:00:02,317 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-03.log
2026-06-03 22:00:02,317 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-03.log
2026-06-03 22:00:02,317 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-03 22:00:02,352 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-03 22:00:02,352 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-03 22:00:02,352 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:00:02,353 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:00:02,353 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:00:02,353 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:00:02,353 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:00:02,353 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-03 22:00:32,353 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection
2026-06-03 22:00:32,354 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:00:32,354 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection
raise sqlite3.Error("Failed to get database connection from pool")
sqlite3.Error: Failed to get database connection from pool
2026-06-03 22:00:32,356 - social_media_monitor.database.connection - WARNING - Database setup attempt 1 failed, retrying in 1s: Failed to get database connection from pool
2026-06-03 22:01:03,356 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection
2026-06-03 22:01:03,357 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:01:03,357 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection
raise sqlite3.Error("Failed to get database connection from pool")
sqlite3.Error: Failed to get database connection from pool
2026-06-03 22:01:03,358 - social_media_monitor.database.connection - WARNING - Database setup attempt 2 failed, retrying in 2s: Failed to get database connection from pool
2026-06-03 22:01:35,358 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection
2026-06-03 22:01:35,359 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:01:35,359 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection
raise sqlite3.Error("Failed to get database connection from pool")
sqlite3.Error: Failed to get database connection from pool
2026-06-03 22:01:35,360 - social_media_monitor.database.connection - ERROR - Failed to set up database after 3 attempts: Failed to get database connection from pool
2026-06-03 22:01:35,360 - __main__ - ERROR - Database initialization failed: Failed to get database connection from pool
2026-06-03 22:01:35,360 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 22:01:35,360 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-03 22:01:35,360 - __main__ - INFO - Closed all database connections
2026-06-03 22:01:35,361 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 22:01:35,361 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-03 22:30:01,855 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-03.log
2026-06-03 22:30:01,855 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-03.log
2026-06-03 22:30:01,855 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-03.log
2026-06-03 22:30:01,855 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-03 22:30:01,887 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-03 22:30:01,887 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-03 22:30:01,887 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-03 22:30:01,888 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:30:01,888 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:30:01,889 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:30:01,889 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:30:01,889 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:30:01,889 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-03 22:30:31,889 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection
2026-06-03 22:30:31,890 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:30:31,892 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection
raise sqlite3.Error("Failed to get database connection from pool")
sqlite3.Error: Failed to get database connection from pool
2026-06-03 22:30:31,894 - social_media_monitor.database.connection - WARNING - Database setup attempt 1 failed, retrying in 1s: Failed to get database connection from pool
2026-06-03 22:31:02,894 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection
2026-06-03 22:31:02,895 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:31:02,895 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection
raise sqlite3.Error("Failed to get database connection from pool")
sqlite3.Error: Failed to get database connection from pool
2026-06-03 22:31:02,896 - social_media_monitor.database.connection - WARNING - Database setup attempt 2 failed, retrying in 2s: Failed to get database connection from pool
2026-06-03 22:31:34,896 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection
2026-06-03 22:31:34,897 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 22:31:34,897 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection
raise sqlite3.Error("Failed to get database connection from pool")
sqlite3.Error: Failed to get database connection from pool
2026-06-03 22:31:34,898 - social_media_monitor.database.connection - ERROR - Failed to set up database after 3 attempts: Failed to get database connection from pool
2026-06-03 22:31:34,898 - __main__ - ERROR - Database initialization failed: Failed to get database connection from pool
2026-06-03 22:31:34,898 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 22:31:34,898 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-03 22:31:34,898 - __main__ - INFO - Closed all database connections
2026-06-03 22:31:34,899 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 22:31:34,899 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-03 23:00:02,504 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-03.log
2026-06-03 23:00:02,504 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-03.log
2026-06-03 23:00:02,504 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-03.log
2026-06-03 23:00:02,504 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-03 23:00:02,541 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-03 23:00:02,541 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-03 23:00:02,542 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 23:00:02,542 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 23:00:02,542 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 23:00:02,543 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 23:00:02,543 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 23:00:02,543 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-03 23:00:32,543 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection
2026-06-03 23:00:32,544 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 23:00:32,544 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection
raise sqlite3.Error("Failed to get database connection from pool")
sqlite3.Error: Failed to get database connection from pool
2026-06-03 23:00:32,545 - social_media_monitor.database.connection - WARNING - Database setup attempt 1 failed, retrying in 1s: Failed to get database connection from pool
2026-06-03 23:01:03,546 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection
2026-06-03 23:01:03,546 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 23:01:03,547 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection
raise sqlite3.Error("Failed to get database connection from pool")
sqlite3.Error: Failed to get database connection from pool
2026-06-03 23:01:03,547 - social_media_monitor.database.connection - WARNING - Database setup attempt 2 failed, retrying in 2s: Failed to get database connection from pool
2026-06-03 23:01:35,548 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection
2026-06-03 23:01:35,548 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed
2026-06-03 23:01:35,549 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection
raise sqlite3.Error("Failed to get database connection from pool")
sqlite3.Error: Failed to get database connection from pool
2026-06-03 23:01:35,549 - social_media_monitor.database.connection - ERROR - Failed to set up database after 3 attempts: Failed to get database connection from pool
2026-06-03 23:01:35,549 - __main__ - ERROR - Database initialization failed: Failed to get database connection from pool
2026-06-03 23:01:35,549 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 23:01:35,549 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-03 23:01:35,550 - __main__ - INFO - Closed all database connections
2026-06-03 23:01:35,550 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-03 23:01:35,550 - social_media_monitor.database.connection - INFO - Closed 0 database connections