โ Logs
social_media_monitor_2026-06-16.log
2026-06-16 20:32:10,169 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-16 20:32:10,170 - __main__ - INFO - Monitor complete. Found 13 total results: 13 new linkedin feed results.
2026-06-16 20:32:10,170 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-16 20:32:10,170 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 20:32:10,182 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-16 20:32:10,182 - __main__ - INFO - Closed all database connections
2026-06-16 20:32:10,183 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 20:32:10,184 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-16 21:00:02,789 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-16.log
2026-06-16 21:00:02,790 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-16.log
2026-06-16 21:00:02,790 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-16.log
2026-06-16 21:00:02,790 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-16 21:00:02,814 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-16 21:00:02,814 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-16 21:00:02,816 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-16 21:00:02,817 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-16 21:00:02,831 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-16 21:00:02,831 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-16 21:00:02,904 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-16 21:00:02,905 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-16 21:00:02,905 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-16 21:00:02,911 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-16 21:00:02,911 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-16 21:00:02,911 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-16 21:00:02,914 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-16 21:00:02,918 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-16 21:00:02,918 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-16 21:00:02,921 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-16 21:00:02,921 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-16 21:00:02,921 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-16 21:00:02,921 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-16 21:00:02,921 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-16 21:00:02,921 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-16 21:00:03,023 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-16 21:00:03,027 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-16 21:00:03,027 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-16 21:00:03,030 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-16 21:00:03,325 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-16 21:00:03,754 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-16 21:00:07,611 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-16 21:00:07,842 - Yiddish24Scraper - INFO - Received response with 474005 characters
2026-06-16 21:00:07,845 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (309668 chars)
2026-06-16 21:00:07,848 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-16 21:00:07,941 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-16 21:00:07,983 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-16 21:00:07,984 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-16 21:00:08,752 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 100 total articles
2026-06-16 21:00:08,753 - Yiddish24Scraper - INFO - Page 1: 11/100 new items
2026-06-16 21:00:08,753 - Yiddish24Scraper - INFO - Low new item ratio (11.0%), stopping pagination
2026-06-16 21:00:08,753 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-06-16 21:00:14,616 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-16 21:00:36,988 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-06-16 21:00:36,988 - IveltScraper - INFO - All forums scrape complete. Found 31 new posts.
2026-06-16 21:00:36,989 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-16 21:00:36,989 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-06-16 21:00:36,989 - __main__ - INFO - Scraper ivelt completed: 31 results
2026-06-16 21:00:37,694 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-16 21:00:37.694099
2026-06-16 21:00:37,694 - __main__ - INFO - Email sent successfully
2026-06-16 21:00:37,694 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-16 21:00:37,694 - __main__ - INFO - Monitor complete. Found 45 total results: 3 new rss results, 11 new yiddish24 results, 31 new ivelt results.
2026-06-16 21:00:37,694 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-16 21:00:37,695 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 21:00:37,815 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-16 21:00:37,815 - __main__ - INFO - Closed all database connections
2026-06-16 21:00:37,817 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 21:00:37,818 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-16 21:10:02,052 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-16.log
2026-06-16 21:10:02,052 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-16.log
2026-06-16 21:10:02,052 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-16.log
2026-06-16 21:10:02,052 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-16 21:10:02,076 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-16 21:10:02,077 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-16 21:10:02,079 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-16 21:10:02,079 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-16 21:10:02,093 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-16 21:10:02,093 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-16 21:10:02,095 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-16 21:10:02,096 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-16 21:10:02,096 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-16 21:10:02,099 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-16 21:10:02,099 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-16 21:10:02,102 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-16 21:10:02,107 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-16 21:10:02,107 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-16 21:10:02,110 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-16 21:10:02,110 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-16 21:10:02,110 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-16 21:10:02,110 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-16 21:10:02,110 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-16 21:10:02,457 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-16 21:10:11,527 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-16 21:10:11,534 - LinkedInFeedScraper - INFO - New LinkedIn feed post: David Genger - Looking to hire a Chief Vibe Officer.
The word vibe keeps coming up again and again. We are hirin
2026-06-16 21:10:11,542 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Pat Walls - "BOOMER" business + MODERN tech = $$$
check this out:
> guy quits Google to acquire a self-storage
2026-06-16 21:10:11,570 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Spencer Thomason - AI Self-Replicating Malware Is Here
AI is no longer just a productivity toolโit is starting to resh
2026-06-16 21:10:11,583 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Giap Nguyen - ๐
I finally vibe-coded my own LLM inference engine.
In a world of ollama, llama.cpp, and vLLM โ why
2026-06-16 21:10:11,598 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Emma Todd - In a world where everyone has access to the same technology, the biggest competitive advantage might
2026-06-16 21:10:11,607 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Martin Schwartz - Well, there's always a first time.
Earlier this week, I was on my very first podcast appearance wit
2026-06-16 21:10:11,625 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Leandro Silva - Chlor-alkali in 2026 is not just a caustic soda or chlorine-demand story anymore.
It is becoming an
2026-06-16 21:10:11,639 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Jeremy Carroll - Why Turing Is Wrong About Reasoning Authority
---
Turingโs mistake was not the machine. It was the t
2026-06-16 21:10:11,667 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Unknown - [no text]
2026-06-16 21:10:11,678 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 9 new posts.
2026-06-16 21:10:11,678 - __main__ - INFO - Scraper linkedin_feed completed: 9 results
2026-06-16 21:10:12,345 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-16 21:10:12.345189
2026-06-16 21:10:12,345 - __main__ - INFO - Email sent successfully
2026-06-16 21:10:12,345 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-16 21:10:12,345 - __main__ - INFO - Monitor complete. Found 9 total results: 9 new linkedin feed results.
2026-06-16 21:10:12,345 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-16 21:10:12,346 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 21:10:12,361 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-16 21:10:12,361 - __main__ - INFO - Closed all database connections
2026-06-16 21:10:12,362 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 21:10:12,362 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-16 22:00:01,942 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-16.log
2026-06-16 22:00:01,942 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-16.log
2026-06-16 22:00:01,942 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-16.log
2026-06-16 22:00:01,942 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-16 22:00:01,966 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-16 22:00:01,966 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-16 22:00:01,968 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-16 22:00:01,970 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-16 22:00:01,999 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-16 22:00:01,999 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-16 22:00:02,000 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-16 22:00:02,001 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-16 22:00:02,003 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-16 22:00:02,007 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-16 22:00:02,007 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-16 22:00:02,007 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-16 22:00:02,009 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-16 22:00:02,014 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-16 22:00:02,014 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-16 22:00:02,016 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-16 22:00:02,016 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-16 22:00:02,016 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-16 22:00:02,017 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-16 22:00:02,017 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-16 22:00:02,017 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-16 22:00:02,119 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-16 22:00:02,124 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-16 22:00:02,124 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-16 22:00:02,127 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-16 22:00:02,419 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-16 22:00:02,790 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-16 22:00:05,987 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-16 22:00:06,047 - Yiddish24Scraper - INFO - Received response with 460634 characters
2026-06-16 22:00:06,052 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (303888 chars)
2026-06-16 22:00:06,055 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-16 22:00:06,148 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-16 22:00:06,193 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-16 22:00:06,193 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-16 22:00:08,115 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles
2026-06-16 22:00:08,115 - Yiddish24Scraper - INFO - Page 1: 5/100 new items
2026-06-16 22:00:08,115 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination
2026-06-16 22:00:08,115 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5
2026-06-16 22:00:13,778 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-16 22:01:06,997 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.
2026-06-16 22:01:06,997 - IveltScraper - INFO - All forums scrape complete. Found 24 new posts.
2026-06-16 22:01:06,997 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-16 22:01:06,998 - __main__ - INFO - Scraper yiddish24 completed: 5 results
2026-06-16 22:01:06,998 - __main__ - INFO - Scraper ivelt completed: 24 results
2026-06-16 22:01:07,639 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-16 22:01:07.639822
2026-06-16 22:01:07,640 - __main__ - INFO - Email sent successfully
2026-06-16 22:01:07,640 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-16 22:01:07,640 - __main__ - INFO - Monitor complete. Found 32 total results: 3 new rss results, 5 new yiddish24 results, 24 new ivelt results.
2026-06-16 22:01:07,640 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-16 22:01:07,641 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 22:01:07,723 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-16 22:01:07,723 - __main__ - INFO - Closed all database connections
2026-06-16 22:01:07,725 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 22:01:07,725 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-16 22:10:01,875 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-16.log
2026-06-16 22:10:01,875 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-16.log
2026-06-16 22:10:01,875 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-16.log
2026-06-16 22:10:01,875 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-16 22:10:01,898 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-16 22:10:01,898 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-16 22:10:01,901 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-16 22:10:01,901 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-16 22:10:01,916 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-16 22:10:01,916 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-16 22:10:01,962 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-16 22:10:01,962 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-16 22:10:01,962 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-16 22:10:01,965 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-16 22:10:01,965 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-16 22:10:01,968 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-16 22:10:01,972 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-16 22:10:01,972 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-16 22:10:01,974 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-16 22:10:01,974 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-16 22:10:01,974 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-16 22:10:01,974 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-16 22:10:01,975 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-16 22:10:02,320 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-16 22:10:12,230 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-16 22:10:12,239 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Nussi Einhorn - Framer just dropped 3.0ย !
Everything changes
https://lnkd.in/gmhpi2wf
2026-06-16 22:10:12,247 - LinkedInFeedScraper - INFO - New LinkedIn feed post: David Wanounou - A 19 year old turned down a job interview because he found out the founders were Jewish.
It's every
2026-06-16 22:10:12,253 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yechiel Zeilingold - I spoke with a new client last night.
They are a โRamsey familyโ
No credit cards, car loans or any o
2026-06-16 22:10:12,263 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Kristian Hossack - 100 applications. 11 recruiter calls. 3 final rounds. 2 offers. 1 accepted. ๐
Eight weeks after bei
2026-06-16 22:10:12,272 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Rahul Raghavan - HPE demonstrates how Agentic Support Automation for HPE Alletra Storage MP B10000 uses AI-driven ano
2026-06-16 22:10:12,279 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Jose Luis Latorre - "I know exactly what the problem is."
"Replace this with AgentSession."
That API doesn't exist anymo
2026-06-16 22:10:12,291 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Noman Ahmed - Left or Right? ๐ค
2026-06-16 22:10:12,298 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Kathrine Louis vom Bauer - Happy Monday team ๐คโจ executive briefing, pt 3 - and I truly believe, this is one of THE most underra
2026-06-16 22:10:12,305 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Chaya Klein - When we decided to market this warehouse for lease, we knew we didn't want another standard property
2026-06-16 22:10:12,313 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Kelly Stanze - So, I'll start by saying: I'll take human copywriters above AI, any day. Ethically, collaboratively,
2026-06-16 22:10:12,321 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Portal Capital Riesgo - Alantra Private Equity strengthens AIVORIQ with two new acquisitions and consolidates one of Spainโs
2026-06-16 22:10:12,335 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Jaydeepsinh Zala - NABH
A Foundation for Excellence in Healthcare
In todayโs rapidly evolving healthcare environment
2026-06-16 22:10:12,343 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Christopher Johnson - Hot take: I'm not mad that AI is writing more code than humans.
I've seen so much crap code in my c
2026-06-16 22:10:12,355 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Vijdan Saeed - ๐ Looking into dashcams for your fleet? Start with smart dashcams. Unlike traditional cameras, smart
2026-06-16 22:10:12,366 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Supermicro - Supermicro SVP of Marketing, Michael McNerney, sits down with Jorge Santos, COO of Verda for an insi
2026-06-16 22:10:12,388 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Unknown - [no text]
2026-06-16 22:10:12,395 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 16 new posts.
2026-06-16 22:10:12,395 - __main__ - INFO - Scraper linkedin_feed completed: 16 results
2026-06-16 22:10:12,988 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-16 22:10:12.988326
2026-06-16 22:10:12,988 - __main__ - INFO - Email sent successfully
2026-06-16 22:10:12,988 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-16 22:10:12,989 - __main__ - INFO - Monitor complete. Found 16 total results: 16 new linkedin feed results.
2026-06-16 22:10:12,989 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-16 22:10:12,989 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 22:10:13,003 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-16 22:10:13,003 - __main__ - INFO - Closed all database connections
2026-06-16 22:10:13,004 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 22:10:13,004 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-16 22:30:02,099 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-16.log
2026-06-16 22:30:02,099 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-16.log
2026-06-16 22:30:02,099 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-16.log
2026-06-16 22:30:02,099 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-16 22:30:02,123 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-16 22:30:02,123 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-16 22:30:02,123 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-16 22:30:02,125 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-16 22:30:02,125 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-16 22:30:02,153 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-16 22:30:02,153 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-16 22:30:02,154 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-16 22:30:02,154 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-16 22:30:02,154 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-16 22:30:02,154 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-16 22:30:02,155 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-16 22:30:02,155 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-16 22:30:02,157 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-16 22:30:02,157 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-16 22:30:02,160 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-16 22:30:02,164 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-16 22:30:02,165 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-16 22:30:02,167 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-16 22:30:02,167 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-16 22:30:02,167 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-16 22:30:02,167 - __main__ - INFO - Running 4 scrapers concurrently...
2026-06-16 22:30:02,167 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-16 22:30:02,167 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-16 22:30:03,254 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-16 22:30:03,287 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Need advice on getting a Hermes agent to create structured content pag
2026-06-16 22:30:03,296 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Build a zero setup AI data analysts after setting up dozens of Hermes
2026-06-16 22:30:04,531 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-06-16 22:30:04,531 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-16 22:30:04,531 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-16 22:30:04,531 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-16 22:30:04,686 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-16 22:30:05,687 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-16 22:30:05,687 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-16 22:30:05,687 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-16 22:30:05,687 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-16 22:30:05,829 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-16 22:30:06,829 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-16 22:30:06,830 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-16 22:30:06,830 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-16 22:30:06,830 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-16 22:30:07,979 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-16 22:30:09,131 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-16 22:30:10,275 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-16 22:30:11,564 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ClaudeWorkflows: [Workflow] CLAUDE.md for Agentic Coding: Integrating Research, Plannin
2026-06-16 22:30:11,591 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/google_antigravity: My AGENT.md file with best practices
2026-06-16 22:30:11,641 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/codex: My AGENT.md file to develop with best practices
2026-06-16 22:30:11,652 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ClaudeCode: My CLAUDE.md file to follow best practices on development
2026-06-16 22:30:11,669 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MervinPraison: Claude Skills Star Surge: How One CLAUDE.md File Hit 176K GitHub Stars
2026-06-16 22:30:11,715 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MervinPraison: [TEST] table-only-strip full
2026-06-16 22:30:11,732 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MervinPraison: [TEST] tables+img
2026-06-16 22:30:11,748 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MervinPraison: [TEST] strip-tables
2026-06-16 22:30:11,767 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MervinPraison: [TEST] fixed-code
2026-06-16 22:30:11,780 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MervinPraison: [TEST] no-table
2026-06-16 22:30:11,792 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MervinPraison: [TEST DELETE] plain
2026-06-16 22:30:11,810 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ArtificialInteligence: Is โAI coworkerโ actually the next interface paradigm?
2026-06-16 22:30:12,920 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-16 22:30:12,920 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-16 22:30:14,072 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-16 22:30:15,219 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-16 22:30:16,368 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-16 22:30:16,369 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-16 22:30:17,521 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 12
2026-06-16 22:30:17,521 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-16 22:30:17,615 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-16 22:30:18,083 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-16 22:30:21,157 - TwitterScraper - INFO - New tweet/X post: #PaperClipDay is tomorrow. ๐
Hereโs an early shout out to our favorit
2026-06-16 22:30:24,313 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-16 22:30:25,245 - TwitterScraper - INFO - New tweet/X post: ๐คฏ GLM-5.2 is here โ built for long-horizon coding and agentic tasks, n
2026-06-16 22:30:30,030 - TwitterScraper - INFO - Twitter/X RSS: 92 entries for 'multica'
2026-06-16 22:30:35,151 - TwitterScraper - INFO - Twitter scrape complete. Found 2 new results.
2026-06-16 22:30:35,151 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-16 22:30:35,834 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-16 22:30:36,535 - LinkedInScraper - INFO - New LinkedIn post: Millie Bowie - UX Designer at Torchbox - LinkedIn
2026-06-16 22:30:36,545 - LinkedInScraper - INFO - New LinkedIn post: peggy fong - Student at Hong Kong Design Institute (HKDI) - LinkedIn
2026-06-16 22:30:37,125 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-16 22:30:37,263 - LinkedInScraper - INFO - New LinkedIn post: This latest blog post's for the Hermes Agent community: we added a Lan
2026-06-16 22:30:38,334 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-16 22:30:38,905 - LinkedInScraper - INFO - New LinkedIn post: Humans are non deterministic, yet we write deterministic code. How is
2026-06-16 22:30:39,022 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 4 new results.
2026-06-16 22:30:41,026 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-16 22:30:41,051 - GitHubScraper - INFO - Found 239 GitHub repositories for term: paperclip
2026-06-16 22:30:42,116 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-16 22:30:42,120 - GitHubScraper - INFO - Found 365 GitHub repositories for term: "Hermes Agent"
2026-06-16 22:30:43,204 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-16 22:30:43,207 - GitHubScraper - INFO - Found 52 GitHub repositories for term: multica
2026-06-16 22:30:43,349 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-16 22:30:43,349 - __main__ - INFO - Scraper reddit completed: 14 results
2026-06-16 22:30:43,349 - __main__ - INFO - Scraper github completed: 0 results
2026-06-16 22:30:43,349 - __main__ - INFO - Scraper twitter completed: 2 results
2026-06-16 22:30:43,349 - __main__ - INFO - Scraper linkedin completed: 4 results
2026-06-16 22:30:43,927 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-16 22:30:43.927625
2026-06-16 22:30:43,928 - __main__ - INFO - Email sent successfully
2026-06-16 22:30:43,928 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-16 22:30:43,928 - __main__ - INFO - Monitor complete. Found 20 total results: 14 new reddit results, 2 new twitter results, 4 new linkedin results.
2026-06-16 22:30:43,928 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-16 22:30:43,928 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 22:30:44,006 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-16 22:30:44,007 - __main__ - INFO - Closed all database connections
2026-06-16 22:30:44,009 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 22:30:44,009 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-16 23:00:02,014 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-16.log
2026-06-16 23:00:02,014 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-16.log
2026-06-16 23:00:02,014 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-16.log
2026-06-16 23:00:02,014 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-16 23:00:02,048 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-16 23:00:02,048 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-16 23:00:02,051 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-16 23:00:02,052 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-16 23:00:02,136 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-16 23:00:02,136 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-16 23:00:02,139 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-16 23:00:02,141 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-16 23:00:02,141 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-16 23:00:02,147 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-16 23:00:02,148 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-16 23:00:02,148 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-16 23:00:02,154 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-16 23:00:02,168 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-16 23:00:02,168 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-16 23:00:02,174 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-16 23:00:02,174 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-16 23:00:02,174 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-16 23:00:02,174 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-16 23:00:02,175 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-16 23:00:02,175 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-16 23:00:02,309 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-16 23:00:02,315 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-16 23:00:02,316 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-16 23:00:02,319 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-16 23:00:03,142 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-16 23:00:03,697 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-16 23:00:13,974 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-16 23:00:22,566 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-16 23:00:22,573 - Yiddish24Scraper - INFO - Received response with 458585 characters
2026-06-16 23:00:22,576 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (303479 chars)
2026-06-16 23:00:22,579 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-16 23:00:22,658 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-16 23:00:22,701 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-16 23:00:22,701 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-16 23:00:23,217 - Yiddish24Scraper - INFO - Term 'ืืืืขืจ ืืืก ืืื ืืขื ืฅ -' matched in DESCRIPTION: 'ืืืืขืจ ืืืก ืืื ืืขื ืฅ - ืืื ืืื ืืขืืืื ื ืฆื ืืืื ืื ืืืืื?'
2026-06-16 23:00:23,217 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-06-16 23:00:23,970 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/DUS_IN_YENTZ_zish_260_260616062219.mp3
2026-06-16 23:00:26,134 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_DUS_IN_YENTZ_zish_260_260616062219.mp3 (47.1 MB)
2026-06-16 23:00:26,135 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-16 23:00:26,177 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_DUS_IN_YENTZ_zish_260_260616062219.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-16 23:00:26,177 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_DUS_IN_YENTZ_zish_260_260616062219_ืืืืขืจ_ืืืก_ืืื_ืืขื ืฅ_-.mp3
2026-06-16 23:00:26,530 - Yiddish24Scraper - INFO - Term 'ืคืจืขืืขื ืืืฆืืขืก ืืื ืคืืจืฉืืขืืื ืืขื' matched in DESCRIPTION: 'ืคืจืขืืขื ืืืฆืืขืก ืืื ืคืืจืฉืืขืืื ืืขื -'
2026-06-16 23:00:26,530 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-06-16 23:00:27,030 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/PRESENTAZIES_avrum_260_260616060326.mp3
2026-06-16 23:00:27,251 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_PRESENTAZIES_avrum_260_260616060326.mp3 (17.6 MB)
2026-06-16 23:00:27,251 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-16 23:00:27,258 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_PRESENTAZIES_avrum_260_260616060326.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-16 23:00:27,259 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_PRESENTAZIES_avrum_260_260616060326_ืคืจืขืืขื ืืืฆืืขืก_ืืื_ืคืืจืฉืืขืืื ืืขื.mp3
2026-06-16 23:00:27,923 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-06-16 23:00:27,923 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-06-16 23:00:27,923 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-06-16 23:00:27,923 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-06-16 23:00:45,840 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-06-16 23:00:45,840 - IveltScraper - INFO - All forums scrape complete. Found 43 new posts.
2026-06-16 23:00:45,840 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-16 23:00:45,841 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-06-16 23:00:45,841 - __main__ - INFO - Scraper ivelt completed: 43 results
2026-06-16 23:00:46,598 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-16 23:00:46.598642
2026-06-16 23:00:46,599 - __main__ - INFO - Email sent successfully
2026-06-16 23:00:46,599 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-16 23:00:46,599 - __main__ - INFO - Monitor complete. Found 52 total results: 3 new rss results, 6 new yiddish24 results, 43 new ivelt results.
2026-06-16 23:00:46,599 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-16 23:00:46,599 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 23:00:46,666 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-16 23:00:46,667 - __main__ - INFO - Closed all database connections
2026-06-16 23:00:46,669 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 23:00:46,669 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-16 23:10:01,975 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-16.log
2026-06-16 23:10:01,977 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-16.log
2026-06-16 23:10:01,977 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-16.log
2026-06-16 23:10:01,977 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-16 23:10:02,000 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-16 23:10:02,001 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-16 23:10:02,003 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-16 23:10:02,003 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-16 23:10:02,016 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-16 23:10:02,017 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-16 23:10:02,063 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-16 23:10:02,064 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-16 23:10:02,064 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-16 23:10:02,067 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-16 23:10:02,067 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-16 23:10:02,069 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-16 23:10:02,074 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-16 23:10:02,074 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-16 23:10:02,076 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-16 23:10:02,076 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-16 23:10:02,076 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-16 23:10:02,076 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-16 23:10:02,076 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-16 23:10:02,501 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-16 23:10:11,844 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-16 23:10:11,856 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ari Torenheim - Hi Everyone,
One of my dear friends is offering professional help to sell on the TikTok Shop.
So
2026-06-16 23:10:11,866 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Uri Follman - Developers ๐ข
if you're using Claude code extension in VS code watch this you'll thank me later
2026-06-16 23:10:11,877 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Uri Follman - So if I do want to be home at dinner, I guess I have to make up that hours at night๐ช๐ he believes th
2026-06-16 23:10:11,891 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Menachem Rabinowitz ๐ - I broke 1M impressions in the past 90 days.
Here's all I did to get there:
- Stay authentic
- Pos
2026-06-16 23:10:11,901 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Berel Solomon - Mr. President we still love you. But what you said needs a slight correction.
2026-06-16 23:10:11,910 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Rui Almeida - My job is to remove friction. Always.
Faster flows, fewer clicks, get the user where they need to go
2026-06-16 23:10:11,925 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Adam Rosler - Most work tools still do not expose the API you wish they had. But if a person can operate the scree
2026-06-16 23:10:11,935 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Gary Dotzlaw - ๐ ๐ผ๐๐ ๐ฐ๐ผ๐บ๐ฝ๐ฎ๐ป๐ถ๐ฒ๐ ๐ฎ๐ฟ๐ฒ ๐๐๐ถ๐ป๐ด ๐๐ ๐ฒ๐
๐ฎ๐ฐ๐๐น๐ ๐ฏ๐ฎ๐ฐ๐ธ๐๐ฎ๐ฟ๐ฑ๐.
They buy the licenses, skip the training, and push e
2026-06-16 23:10:11,943 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Tony Vu - Making a self note for myself just incase I forget, that the ReactJS library seems to handle Event D
2026-06-16 23:10:11,967 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Angi Ghimpeteanu - A client came in with a list of interface complaints. Crowded screens. Admins buried in repetitive w
2026-06-16 23:10:11,984 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Moshe Milstein - Original Concept/Composed by Moshe Milstein.
Not too long ago I had an amazing experience. I was si
2026-06-16 23:10:12,022 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Unknown - [no text]
2026-06-16 23:10:12,031 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 12 new posts.
2026-06-16 23:10:12,031 - __main__ - INFO - Scraper linkedin_feed completed: 12 results
2026-06-16 23:10:12,570 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-16 23:10:12.570402
2026-06-16 23:10:12,570 - __main__ - INFO - Email sent successfully
2026-06-16 23:10:12,571 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-16 23:10:12,571 - __main__ - INFO - Monitor complete. Found 12 total results: 12 new linkedin feed results.
2026-06-16 23:10:12,571 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-16 23:10:12,571 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 23:10:12,638 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-16 23:10:12,639 - __main__ - INFO - Closed all database connections
2026-06-16 23:10:12,640 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-16 23:10:12,640 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...