← Logs

social_media_monitor_2026-05-14.log

2026-05-14 18:45:03,169 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ahblicklive.com/new_ded_video/26/20/QoquliVzLP5zqVz0sIf/ahubrh/ahubrh.mp4

2026-05-14 18:45:04,240 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: BL_ahubrh.mp4 (5.6 MB)

2026-05-14 18:45:04,243 - social_media_monitor.utils.file_downloader - INFO - Organized video file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Video (video/mp4)

2026-05-14 18:45:04,262 - social_media_monitor.utils.media_tagger - INFO - Tagged BL_ahubrh.mp4: title, album, comment, genre

2026-05-14 18:45:04,293 - AhBlickLiveScraper - INFO - Downloading video: הערליכע בילדער פון די נסיעה פון כ"ק אדמו"ר מסאטמאר

2026-05-14 18:45:04,793 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ahblicklive.com/new_ded_video/26/20/ORAwqxWsoknvaR8DXrT/rld22V/rld22V.mp4

2026-05-14 18:45:04,934 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: BL_rld22V.mp4 (1.8 MB)

2026-05-14 18:45:04,934 - social_media_monitor.utils.file_downloader - INFO - Organized video file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Video (video/mp4)

2026-05-14 18:45:04,941 - social_media_monitor.utils.media_tagger - INFO - Tagged BL_rld22V.mp4: title, album, comment, genre

2026-05-14 18:45:04,954 - AhBlickLiveScraper - INFO - Downloading video: א מינוט מיט ר' מיילך שליט"א-יום ה' פרשת במדבר כז'

2026-05-14 18:45:05,794 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ahblicklive.com/new_ded_video/26/20/UCgnY8EcRH9Wt14dR7U/mYdQ0h/mYdQ0h.mp4

2026-05-14 18:45:06,629 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: BL_mYdQ0h.mp4 (20.3 MB)

2026-05-14 18:45:06,630 - social_media_monitor.utils.file_downloader - INFO - Organized video file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Video (video/mp4)

2026-05-14 18:45:06,649 - social_media_monitor.utils.media_tagger - INFO - Tagged BL_mYdQ0h.mp4: title, album, comment, genre

2026-05-14 18:45:06,678 - AhBlickLiveScraper - INFO - Downloading video: אינטערסאנטע געשיכטע: ר"ר מיילעך מיט ר' זושא...

2026-05-14 18:45:07,179 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ahblicklive.com/new_ded_video/26/20/aso570rPh9zL5sFkmMo/F9ZvfZ/F9ZvfZ.mp4

2026-05-14 18:45:07,407 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: BL_F9ZvfZ.mp4 (3.4 MB)

2026-05-14 18:45:07,408 - social_media_monitor.utils.file_downloader - INFO - Organized video file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Video (video/mp4)

2026-05-14 18:45:07,414 - social_media_monitor.utils.media_tagger - INFO - Tagged BL_F9ZvfZ.mp4: title, album, comment, genre

2026-05-14 18:45:07,427 - AhBlickLiveScraper - INFO - Downloading video: הערליכע מעשה איבער די שידוך בבית עקשטיין - שפיצער,

2026-05-14 18:45:08,179 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ahblicklive.com/new_ded_video/26/20/yvjuDvuJtniuSUXuWL2/NQxT0K/NQxT0K.mp4

2026-05-14 18:45:10,124 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: BL_NQxT0K.mp4 (48.0 MB)

2026-05-14 18:45:10,125 - social_media_monitor.utils.file_downloader - INFO - Organized video file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Video (video/mp4)

2026-05-14 18:45:10,160 - social_media_monitor.utils.media_tagger - INFO - Tagged BL_NQxT0K.mp4: title, album, comment, genre

2026-05-14 18:45:10,160 - AhBlickLiveScraper - INFO - Total AhBlickLive results: 5

2026-05-14 18:45:10,161 - __main__ - INFO - Scraper ahblicklive completed: 5 results

2026-05-14 18:45:10,868 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-14 18:45:10.868231

2026-05-14 18:45:10,868 - __main__ - INFO - Email sent successfully

2026-05-14 18:45:10,868 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-14 18:45:10,869 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new ahblicklive results.

2026-05-14 18:45:10,869 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-14 18:45:10,869 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 18:45:10,886 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-14 18:45:10,886 - __main__ - INFO - Closed all database connections

2026-05-14 18:45:10,890 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 18:45:10,890 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-14 19:00:01,998 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-14.log

2026-05-14 19:00:01,998 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-14.log

2026-05-14 19:00:01,998 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-14.log

2026-05-14 19:00:01,998 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-14 19:00:02,022 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-14 19:00:02,022 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-14 19:00:02,026 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-14 19:00:02,027 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-14 19:00:02,044 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-14 19:00:02,045 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-14 19:00:02,046 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-14 19:00:02,047 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-14 19:00:02,047 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-14 19:00:02,049 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-14 19:00:02,049 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-14 19:00:02,049 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-14 19:00:02,069 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-14 19:00:02,073 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-14 19:00:02,074 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-14 19:00:02,076 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-14 19:00:02,076 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-14 19:00:02,076 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-14 19:00:02,076 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-14 19:00:02,076 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-14 19:00:02,076 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-14 19:00:02,165 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-14 19:00:02,170 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-14 19:00:02,170 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-14 19:00:02,172 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-14 19:00:02,476 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-14 19:00:02,956 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom

2026-05-14 19:00:03,553 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"

2026-05-14 19:00:04,390 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"

2026-05-14 19:00:05,538 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"

2026-05-14 19:00:06,394 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"

2026-05-14 19:00:07,320 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-14 19:00:07,524 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"

2026-05-14 19:00:07,557 - Yiddish24Scraper - INFO - Received response with 506601 characters

2026-05-14 19:00:07,563 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (310682 chars)

2026-05-14 19:00:07,567 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-14 19:00:07,657 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-14 19:00:07,703 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-14 19:00:07,703 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-14 19:00:08,537 - Yiddish24Scraper - INFO - Page 1 summary: 2 new out of 100 total articles

2026-05-14 19:00:08,537 - Yiddish24Scraper - INFO - Page 1: 2/100 new items

2026-05-14 19:00:08,537 - Yiddish24Scraper - INFO - Low new item ratio (2.0%), stopping pagination

2026-05-14 19:00:08,538 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 2

2026-05-14 19:00:08,553 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"

2026-05-14 19:00:09,685 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"

2026-05-14 19:00:10,554 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"

2026-05-14 19:00:11,718 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"

2026-05-14 19:00:12,557 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"

2026-05-14 19:00:13,685 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"

2026-05-14 19:00:13,929 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-14 19:00:14,562 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"

2026-05-14 19:00:15,886 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"

2026-05-14 19:00:16,688 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"

2026-05-14 19:00:17,563 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"

2026-05-14 19:00:18,714 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"

2026-05-14 19:00:24,456 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"

2026-05-14 19:00:24,659 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"

2026-05-14 19:00:25,488 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"

2026-05-14 19:00:26,665 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"

2026-05-14 19:00:26,677 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-14 19:00:51,455 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 84 new posts.

2026-05-14 19:00:51,456 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-14 19:00:51,456 - __main__ - INFO - Scraper yiddish24 completed: 2 results

2026-05-14 19:00:51,456 - __main__ - INFO - Scraper ivelt completed: 84 results

2026-05-14 19:00:52,280 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-14 19:00:52.280330

2026-05-14 19:00:52,280 - __main__ - INFO - Email sent successfully

2026-05-14 19:00:52,280 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-14 19:00:52,281 - __main__ - INFO - Monitor complete. Found 89 total results: 3 new rss results, 2 new yiddish24 results, 84 new ivelt results.

2026-05-14 19:00:52,281 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-14 19:00:52,281 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 19:00:52,358 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-14 19:00:52,358 - __main__ - INFO - Closed all database connections

2026-05-14 19:00:52,360 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 19:00:52,361 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-14 20:00:01,956 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-14.log

2026-05-14 20:00:01,956 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-14.log

2026-05-14 20:00:01,956 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-14.log

2026-05-14 20:00:01,956 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-14 20:00:01,980 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-14 20:00:01,980 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-14 20:00:01,982 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-14 20:00:01,983 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-14 20:00:01,999 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-14 20:00:01,999 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-14 20:00:02,040 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-14 20:00:02,041 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-14 20:00:02,041 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-14 20:00:02,052 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-14 20:00:02,052 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-14 20:00:02,052 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-14 20:00:02,055 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-14 20:00:02,059 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-14 20:00:02,059 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-14 20:00:02,061 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-14 20:00:02,061 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-14 20:00:02,061 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-14 20:00:02,061 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-14 20:00:02,061 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-14 20:00:02,061 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-14 20:00:02,145 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-14 20:00:02,148 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-14 20:00:02,149 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-14 20:00:02,149 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-14 20:00:02,510 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-14 20:00:03,059 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom

2026-05-14 20:00:03,623 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"

2026-05-14 20:00:04,475 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"

2026-05-14 20:00:05,623 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"

2026-05-14 20:00:06,471 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"

2026-05-14 20:00:07,117 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-14 20:00:07,123 - Yiddish24Scraper - INFO - Received response with 530803 characters

2026-05-14 20:00:07,127 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318457 chars)

2026-05-14 20:00:07,131 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-14 20:00:07,221 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-14 20:00:07,260 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-14 20:00:07,260 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-14 20:00:08,128 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles

2026-05-14 20:00:08,129 - Yiddish24Scraper - INFO - Page 1: 6/100 new items

2026-05-14 20:00:08,129 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination

2026-05-14 20:00:08,129 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-05-14 20:00:08,321 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"

2026-05-14 20:00:09,143 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"

2026-05-14 20:00:10,341 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"

2026-05-14 20:00:11,145 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"

2026-05-14 20:00:12,321 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"

2026-05-14 20:00:13,148 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"

2026-05-14 20:00:13,959 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-14 20:00:14,305 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"

2026-05-14 20:00:15,150 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"

2026-05-14 20:00:16,339 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"

2026-05-14 20:00:17,338 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"

2026-05-14 20:00:18,155 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"

2026-05-14 20:00:19,381 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"

2026-05-14 20:00:20,158 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"

2026-05-14 20:00:21,318 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"

2026-05-14 20:00:22,161 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"

2026-05-14 20:00:23,298 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"

2026-05-14 20:00:23,318 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-14 20:00:48,014 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 49 new posts.

2026-05-14 20:00:48,014 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-14 20:00:48,014 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-05-14 20:00:48,014 - __main__ - INFO - Scraper ivelt completed: 49 results

2026-05-14 20:00:48,723 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-14 20:00:48.723167

2026-05-14 20:00:48,723 - __main__ - INFO - Email sent successfully

2026-05-14 20:00:48,723 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-14 20:00:48,723 - __main__ - INFO - Monitor complete. Found 58 total results: 3 new rss results, 6 new yiddish24 results, 49 new ivelt results.

2026-05-14 20:00:48,723 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-14 20:00:48,724 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 20:00:48,821 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-14 20:00:48,822 - __main__ - INFO - Closed all database connections

2026-05-14 20:00:48,823 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 20:00:48,824 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-14 20:30:02,310 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-14.log

2026-05-14 20:30:02,310 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-14.log

2026-05-14 20:30:02,310 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-14.log

2026-05-14 20:30:02,310 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-14 20:30:02,333 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-14 20:30:02,333 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-05-14 20:30:02,333 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-14 20:30:02,335 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-14 20:30:02,336 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-14 20:30:02,352 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-14 20:30:02,352 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-14 20:30:02,353 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-14 20:30:02,353 - __main__ - INFO - Reddit scraper initialized and enabled

2026-05-14 20:30:02,353 - __main__ - INFO - GitHub scraper initialized and enabled

2026-05-14 20:30:02,353 - __main__ - INFO - Twitter scraper initialized and enabled

2026-05-14 20:30:02,353 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-14 20:30:02,354 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-05-14 20:30:02,354 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-05-14 20:30:02,356 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-14 20:30:02,356 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-14 20:30:02,370 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-14 20:30:02,374 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-14 20:30:02,374 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-14 20:30:02,376 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-14 20:30:02,376 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-14 20:30:02,377 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-14 20:30:02,377 - __main__ - INFO - Running 5 scrapers concurrently...

2026-05-14 20:30:02,377 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-14 20:30:02,377 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-05-14 20:30:03,443 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-05-14 20:30:03,503 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Codex And Hermes Creates A 24/7 AI Agent Stack

2026-05-14 20:30:03,516 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Web UI vs Workspace: Who Wins?

2026-05-14 20:30:03,533 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Nous Research co-founder just RT’d our Hermes Agent meetup in Arlingto

2026-05-14 20:30:03,546 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: NEW Codex + Hermes Agent MCP is Insane! (FREE!)

2026-05-14 20:30:03,560 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Agent eval for the Hermes stack

2026-05-14 20:30:03,570 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Can i use the CLI on a vps with Ubuntu ?

2026-05-14 20:30:04,745 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 6

2026-05-14 20:30:04,746 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-05-14 20:30:04,746 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-05-14 20:30:04,746 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-05-14 20:30:06,082 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-05-14 20:30:06,133 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Paperclip + Hermes on Docker installation not working

2026-05-14 20:30:06,146 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: We’re Les Claypool and Sean Ono Lennon from The Claypool Lennon Deliri

2026-05-14 20:30:06,156 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: hermes(local) paperclip adapter issue

2026-05-14 20:30:07,309 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 3

2026-05-14 20:30:07,310 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-05-14 20:30:07,310 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-05-14 20:30:07,310 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-05-14 20:30:08,527 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-05-14 20:30:09,807 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-14 20:30:09,807 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-05-14 20:30:09,807 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-05-14 20:30:09,808 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-05-14 20:30:10,978 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: How I run Hermes locally on a mini PC: Tailscale remote access, hybrid

2026-05-14 20:30:10,991 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/LocalLLM: How to run browser automation using hermes and llama.cpp ( local model

2026-05-14 20:30:11,004 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ollama: Testing Ollama agents against themselves

2026-05-14 20:30:12,144 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-05-14 20:30:14,348 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-05-14 20:30:16,196 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/accelerate: Welcome to May 14, 2026 - Dr. Alex Wissner-Gross

2026-05-14 20:30:17,351 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-05-14 20:30:19,408 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-05-14 20:30:19,409 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-05-14 20:30:21,939 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-05-14 20:30:24,412 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-05-14 20:30:26,951 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-05-14 20:30:26,951 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-05-14 20:30:29,215 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 4

2026-05-14 20:30:29,215 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-14 20:30:29,348 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-14 20:30:29,909 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-05-14 20:30:45,561 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-05-14 20:31:01,298 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-05-14 20:31:16,478 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-05-14 20:31:16,479 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-14 20:31:17,104 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-05-14 20:31:18,416 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-05-14 20:31:18,842 - LinkedInScraper - INFO - New LinkedIn post: Get Your Agent a Brain: Getting Started with hermes-cashew - LinkedIn

2026-05-14 20:31:19,142 - LinkedInScraper - INFO - New LinkedIn post: And within 24 hrs, Command Code is now the 3rd most used coding agent

2026-05-14 20:31:19,841 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-05-14 20:31:20,646 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.

2026-05-14 20:31:20,647 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-05-14 20:31:26,575 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-14 20:31:26,600 - GitHubScraper - INFO - Found 227 GitHub repositories for term: paperclip

2026-05-14 20:31:27,717 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-14 20:31:27,720 - GitHubScraper - INFO - Found 222 GitHub repositories for term: "Hermes Agent"

2026-05-14 20:31:28,821 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-14 20:31:28,824 - GitHubScraper - INFO - Found 45 GitHub repositories for term: multica

2026-05-14 20:31:28,974 - GitHubScraper - INFO - Total GitHub results found: 0

2026-05-14 20:31:28,975 - __main__ - INFO - Scraper reddit completed: 13 results

2026-05-14 20:31:28,975 - __main__ - INFO - Scraper github completed: 0 results

2026-05-14 20:31:28,975 - __main__ - INFO - Scraper twitter completed: 0 results

2026-05-14 20:31:28,975 - __main__ - INFO - Scraper linkedin completed: 2 results

2026-05-14 20:31:28,975 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-05-14 20:31:29,610 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-14 20:31:29.610303

2026-05-14 20:31:29,610 - __main__ - INFO - Email sent successfully

2026-05-14 20:31:29,611 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-14 20:31:29,611 - __main__ - INFO - Monitor complete. Found 15 total results: 13 new reddit results, 2 new linkedin results.

2026-05-14 20:31:29,611 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-14 20:31:29,611 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 20:31:29,720 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-14 20:31:29,720 - __main__ - INFO - Closed all database connections

2026-05-14 20:31:29,763 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 20:31:29,778 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-14 21:00:02,556 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-14.log

2026-05-14 21:00:02,556 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-14.log

2026-05-14 21:00:02,556 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-14.log

2026-05-14 21:00:02,556 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-14 21:00:02,581 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-14 21:00:02,581 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-14 21:00:02,583 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-14 21:00:02,583 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-14 21:00:02,611 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-14 21:00:02,611 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-14 21:00:02,653 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-14 21:00:02,654 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-14 21:00:02,654 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-14 21:00:02,671 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-14 21:00:02,671 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-14 21:00:02,671 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-14 21:00:02,673 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-14 21:00:02,677 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-14 21:00:02,677 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-14 21:00:02,679 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-14 21:00:02,679 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-14 21:00:02,679 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-14 21:00:02,679 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-14 21:00:02,679 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-14 21:00:02,679 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-14 21:00:02,759 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-14 21:00:02,763 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-14 21:00:02,763 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-14 21:00:02,764 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-14 21:00:03,153 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-14 21:00:03,696 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom

2026-05-14 21:00:04,300 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"

2026-05-14 21:00:05,141 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"

2026-05-14 21:00:06,272 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"

2026-05-14 21:00:07,143 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"

2026-05-14 21:00:07,551 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-14 21:00:07,799 - Yiddish24Scraper - INFO - Received response with 518751 characters

2026-05-14 21:00:07,802 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (314160 chars)

2026-05-14 21:00:07,805 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-14 21:00:07,893 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-14 21:00:07,932 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-14 21:00:07,932 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-14 21:00:08,693 - Yiddish24Scraper - INFO - Page 1 summary: 9 new out of 100 total articles

2026-05-14 21:00:08,693 - Yiddish24Scraper - INFO - Page 1: 9/100 new items

2026-05-14 21:00:08,693 - Yiddish24Scraper - INFO - Low new item ratio (9.0%), stopping pagination

2026-05-14 21:00:08,694 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 9

2026-05-14 21:00:08,834 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"

2026-05-14 21:00:09,706 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"

2026-05-14 21:00:10,839 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"

2026-05-14 21:00:11,709 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"

2026-05-14 21:00:12,857 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"

2026-05-14 21:00:13,713 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"

2026-05-14 21:00:14,407 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-14 21:00:14,833 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"

2026-05-14 21:00:15,716 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"

2026-05-14 21:00:16,872 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"

2026-05-14 21:00:17,858 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"

2026-05-14 21:00:18,719 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"

2026-05-14 21:00:19,863 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"

2026-05-14 21:00:20,723 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"

2026-05-14 21:00:21,882 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"

2026-05-14 21:00:22,725 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"

2026-05-14 21:00:24,048 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"

2026-05-14 21:00:24,070 - RSSFeedScraper - INFO - Total RSS/HTML results: 22

2026-05-14 21:00:43,145 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 31 new posts.

2026-05-14 21:00:43,145 - __main__ - INFO - Scraper rss completed: 22 results

2026-05-14 21:00:43,145 - __main__ - INFO - Scraper yiddish24 completed: 9 results

2026-05-14 21:00:43,145 - __main__ - INFO - Scraper ivelt completed: 31 results

2026-05-14 21:00:44,184 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-14 21:00:44.184461

2026-05-14 21:00:44,184 - __main__ - INFO - Email sent successfully

2026-05-14 21:00:44,185 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-14 21:00:44,185 - __main__ - INFO - Monitor complete. Found 62 total results: 22 new rss results, 9 new yiddish24 results, 31 new ivelt results.

2026-05-14 21:00:44,185 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-14 21:00:44,185 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 21:00:44,270 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-14 21:00:44,270 - __main__ - INFO - Closed all database connections

2026-05-14 21:00:44,273 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 21:00:44,273 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-14 22:00:02,203 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-14.log

2026-05-14 22:00:02,203 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-14.log

2026-05-14 22:00:02,203 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-14.log

2026-05-14 22:00:02,204 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-14 22:00:02,229 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-14 22:00:02,229 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-14 22:00:02,230 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 22:00:02,231 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 22:00:02,231 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-14 22:00:32,231 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection

2026-05-14 22:00:32,232 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 22:00:32,232 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool

Traceback (most recent call last):

File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection

raise sqlite3.Error("Failed to get database connection from pool")

sqlite3.Error: Failed to get database connection from pool

2026-05-14 22:00:32,233 - social_media_monitor.database.connection - WARNING - Database setup attempt 1 failed, retrying in 1s: Failed to get database connection from pool

2026-05-14 22:01:03,234 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection

2026-05-14 22:01:03,234 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 22:01:03,234 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool

Traceback (most recent call last):

File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection

raise sqlite3.Error("Failed to get database connection from pool")

sqlite3.Error: Failed to get database connection from pool

2026-05-14 22:01:03,235 - social_media_monitor.database.connection - WARNING - Database setup attempt 2 failed, retrying in 2s: Failed to get database connection from pool

2026-05-14 22:01:35,235 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection

2026-05-14 22:01:35,236 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 22:01:35,236 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool

Traceback (most recent call last):

File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection

raise sqlite3.Error("Failed to get database connection from pool")

sqlite3.Error: Failed to get database connection from pool

2026-05-14 22:01:35,237 - social_media_monitor.database.connection - ERROR - Failed to set up database after 3 attempts: Failed to get database connection from pool

2026-05-14 22:01:35,237 - __main__ - ERROR - Database initialization failed: Failed to get database connection from pool

2026-05-14 22:01:35,237 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 22:01:35,237 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-14 22:01:35,237 - __main__ - INFO - Closed all database connections

2026-05-14 22:01:35,238 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 22:01:35,238 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-14 22:30:02,598 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-14.log

2026-05-14 22:30:02,598 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-14.log

2026-05-14 22:30:02,599 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-14.log

2026-05-14 22:30:02,599 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-14 22:30:02,621 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-14 22:30:02,621 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-05-14 22:30:02,621 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-14 22:30:02,622 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 22:30:02,623 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 22:30:02,623 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-14 22:30:32,623 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection

2026-05-14 22:30:32,623 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 22:30:32,623 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool

Traceback (most recent call last):

File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection

raise sqlite3.Error("Failed to get database connection from pool")

sqlite3.Error: Failed to get database connection from pool

2026-05-14 22:30:32,624 - social_media_monitor.database.connection - WARNING - Database setup attempt 1 failed, retrying in 1s: Failed to get database connection from pool

2026-05-14 22:31:03,625 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection

2026-05-14 22:31:03,625 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 22:31:03,630 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool

Traceback (most recent call last):

File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection

raise sqlite3.Error("Failed to get database connection from pool")

sqlite3.Error: Failed to get database connection from pool

2026-05-14 22:31:03,631 - social_media_monitor.database.connection - WARNING - Database setup attempt 2 failed, retrying in 2s: Failed to get database connection from pool

2026-05-14 22:31:35,632 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection

2026-05-14 22:31:35,632 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 22:31:35,633 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool

Traceback (most recent call last):

File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection

raise sqlite3.Error("Failed to get database connection from pool")

sqlite3.Error: Failed to get database connection from pool

2026-05-14 22:31:35,633 - social_media_monitor.database.connection - ERROR - Failed to set up database after 3 attempts: Failed to get database connection from pool

2026-05-14 22:31:35,633 - __main__ - ERROR - Database initialization failed: Failed to get database connection from pool

2026-05-14 22:31:35,633 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 22:31:35,633 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-14 22:31:35,634 - __main__ - INFO - Closed all database connections

2026-05-14 22:31:35,634 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 22:31:35,634 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-14 23:00:02,028 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-14.log

2026-05-14 23:00:02,028 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-14.log

2026-05-14 23:00:02,028 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-14.log

2026-05-14 23:00:02,028 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-14 23:00:02,052 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-14 23:00:02,052 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-14 23:00:02,053 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 23:00:02,054 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 23:00:02,054 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-14 23:00:32,054 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection

2026-05-14 23:00:32,055 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 23:00:32,055 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool

Traceback (most recent call last):

File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection

raise sqlite3.Error("Failed to get database connection from pool")

sqlite3.Error: Failed to get database connection from pool

2026-05-14 23:00:32,056 - social_media_monitor.database.connection - WARNING - Database setup attempt 1 failed, retrying in 1s: Failed to get database connection from pool

2026-05-14 23:01:03,057 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection

2026-05-14 23:01:03,057 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 23:01:03,060 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool

Traceback (most recent call last):

File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection

raise sqlite3.Error("Failed to get database connection from pool")

sqlite3.Error: Failed to get database connection from pool

2026-05-14 23:01:03,060 - social_media_monitor.database.connection - WARNING - Database setup attempt 2 failed, retrying in 2s: Failed to get database connection from pool

2026-05-14 23:01:35,061 - social_media_monitor.database.connection - INFO - Pool exhausted, creating additional connection

2026-05-14 23:01:35,061 - social_media_monitor.database.connection - ERROR - Failed to create database connection: database disk image is malformed

2026-05-14 23:01:35,061 - social_media_monitor.database.connection - ERROR - Database error: Failed to get database connection from pool

Traceback (most recent call last):

File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/database/connection.py", line 233, in get_db_connection

raise sqlite3.Error("Failed to get database connection from pool")

sqlite3.Error: Failed to get database connection from pool

2026-05-14 23:01:35,062 - social_media_monitor.database.connection - ERROR - Failed to set up database after 3 attempts: Failed to get database connection from pool

2026-05-14 23:01:35,062 - __main__ - ERROR - Database initialization failed: Failed to get database connection from pool

2026-05-14 23:01:35,062 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 23:01:35,062 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-14 23:01:35,062 - __main__ - INFO - Closed all database connections

2026-05-14 23:01:35,062 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-14 23:01:35,062 - social_media_monitor.database.connection - INFO - Closed 0 database connections