โ Logs
social_media_monitor_2026-06-17.log
2026-06-17 21:01:02,659 - __main__ - INFO - Email sent successfully
2026-06-17 21:01:02,659 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-17 21:01:02,659 - __main__ - INFO - Monitor complete. Found 93 total results: 4 new rss results, 8 new yiddish24 results, 81 new ivelt results.
2026-06-17 21:01:02,659 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-17 21:01:02,659 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 21:01:02,888 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-17 21:01:02,888 - __main__ - INFO - Closed all database connections
2026-06-17 21:01:02,889 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 21:01:02,889 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-17 21:10:02,037 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-17.log
2026-06-17 21:10:02,037 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-17.log
2026-06-17 21:10:02,037 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-17.log
2026-06-17 21:10:02,037 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-17 21:10:02,060 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-17 21:10:02,061 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-17 21:10:02,063 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-17 21:10:02,063 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-17 21:10:02,079 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-17 21:10:02,079 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-17 21:10:02,080 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-17 21:10:02,080 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-17 21:10:02,081 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-17 21:10:02,083 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-17 21:10:02,084 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-17 21:10:02,086 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-17 21:10:02,090 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-17 21:10:02,091 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-17 21:10:02,093 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-17 21:10:02,093 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-17 21:10:02,093 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-17 21:10:02,093 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-17 21:10:02,093 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-17 21:10:02,093 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-17 21:10:02,910 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-17 21:10:04,658 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-17 21:10:04,659 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-17 21:10:04,659 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-17 21:10:04,659 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-17 21:10:04,810 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-17 21:10:05,810 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-17 21:10:05,811 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-17 21:10:05,811 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-17 21:10:05,811 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-17 21:10:05,963 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-17 21:10:06,964 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-17 21:10:06,964 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-17 21:10:06,964 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-17 21:10:06,964 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-17 21:10:08,120 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-17 21:10:09,274 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-17 21:10:10,427 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-17 21:10:11,582 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-17 21:10:11,582 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-17 21:10:12,735 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-17 21:10:13,896 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-17 21:10:15,045 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-17 21:10:15,046 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-17 21:10:16,198 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-17 21:10:16,198 - __main__ - INFO - Scraper reddit completed: 0 results
2026-06-17 21:10:16,199 - __main__ - INFO - No new results found across all enabled sources
2026-06-17 21:10:16,199 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-17 21:10:16,199 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-06-17 21:10:16,199 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-17 21:10:16,199 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 21:10:16,337 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-17 21:10:16,337 - __main__ - INFO - Closed all database connections
2026-06-17 21:10:16,338 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 21:10:16,338 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-17 22:00:01,652 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-17.log
2026-06-17 22:00:01,652 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-17.log
2026-06-17 22:00:01,652 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-17.log
2026-06-17 22:00:01,652 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-17 22:00:01,677 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-17 22:00:01,677 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-17 22:00:01,679 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-17 22:00:01,680 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-17 22:00:01,698 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-17 22:00:01,698 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-17 22:00:01,699 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-17 22:00:01,700 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-17 22:00:01,700 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-17 22:00:01,702 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-17 22:00:01,702 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-17 22:00:01,702 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-17 22:00:01,705 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-17 22:00:01,710 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-17 22:00:01,710 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-17 22:00:01,712 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-17 22:00:01,712 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-17 22:00:01,712 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-17 22:00:01,712 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-17 22:00:01,712 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-17 22:00:01,712 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-17 22:00:01,800 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-17 22:00:01,804 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-17 22:00:01,804 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-17 22:00:01,805 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-17 22:00:02,071 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-17 22:00:02,538 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-06-17 22:00:05,796 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-17 22:00:05,836 - Yiddish24Scraper - INFO - Received response with 502484 characters
2026-06-17 22:00:05,839 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313213 chars)
2026-06-17 22:00:05,842 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-17 22:00:05,930 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-17 22:00:05,970 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-17 22:00:05,970 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-17 22:00:05,979 - Yiddish24Scraper - INFO - Term 'ืืืืขืจ ืืืก ืืื ืืขื ืฅ -' matched in DESCRIPTION: 'ืืืืขืจ ืืืก ืืื ืืขื ืฅ - ืืขืจ ืืื ืืขืจ ืืื ืฆืขืจืืกื ืฆืืืืฉื ืืขืจ ืืชื ืืื ืืขืจ ืืืืชื'
2026-06-17 22:00:05,979 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-06-17 22:00:06,480 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/DUS_IN_YENTZ_tosig_260_260617054909.mp3
2026-06-17 22:00:07,079 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_DUS_IN_YENTZ_tosig_260_260617054909.mp3 (73.2 MB)
2026-06-17 22:00:07,080 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-17 22:00:07,107 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_DUS_IN_YENTZ_tosig_260_260617054909.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-17 22:00:07,107 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_DUS_IN_YENTZ_tosig_260_260617054909_ืืืืขืจ_ืืืก_ืืื_ืืขื ืฅ_-.mp3
2026-06-17 22:00:07,844 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 100 total articles
2026-06-17 22:00:07,844 - Yiddish24Scraper - INFO - Page 1: 4/100 new items
2026-06-17 22:00:07,844 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination
2026-06-17 22:00:07,845 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4
2026-06-17 22:00:13,624 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-17 22:00:27,373 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 25 new posts.
2026-06-17 22:00:27,374 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-17 22:00:27,374 - __main__ - INFO - Scraper yiddish24 completed: 4 results
2026-06-17 22:00:27,374 - __main__ - INFO - Scraper ivelt completed: 25 results
2026-06-17 22:00:28,109 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-17 22:00:28.109662
2026-06-17 22:00:28,109 - __main__ - INFO - Email sent successfully
2026-06-17 22:00:28,110 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-17 22:00:28,110 - __main__ - INFO - Monitor complete. Found 33 total results: 4 new rss results, 4 new yiddish24 results, 25 new ivelt results.
2026-06-17 22:00:28,110 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-17 22:00:28,110 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 22:00:28,229 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-17 22:00:28,229 - __main__ - INFO - Closed all database connections
2026-06-17 22:00:28,231 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 22:00:28,231 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-17 22:10:02,430 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-17.log
2026-06-17 22:10:02,430 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-17.log
2026-06-17 22:10:02,430 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-17.log
2026-06-17 22:10:02,430 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-17 22:10:02,454 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-17 22:10:02,454 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-17 22:10:02,456 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-17 22:10:02,456 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-17 22:10:02,464 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-17.log
2026-06-17 22:10:02,464 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-17.log
2026-06-17 22:10:02,464 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-17.log
2026-06-17 22:10:02,464 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-17 22:10:02,475 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-17 22:10:02,475 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-17 22:10:02,487 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-17 22:10:02,487 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-17 22:10:02,489 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-17 22:10:02,499 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-17 22:10:02,510 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-17 22:10:02,511 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-17 22:10:02,516 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-17 22:10:02,516 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-17 22:10:02,517 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-17 22:10:02,519 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-17 22:10:02,519 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-17 22:10:02,522 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-17 22:10:02,526 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-17 22:10:02,526 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-17 22:10:02,528 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-17 22:10:02,528 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-17 22:10:02,528 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-17 22:10:02,528 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-17 22:10:02,529 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-17 22:10:02,529 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-17 22:10:02,554 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-17 22:10:02,555 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-17 22:10:02,555 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-17 22:10:02,555 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-17 22:10:02,558 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-17 22:10:02,558 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-17 22:10:02,560 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-17 22:10:02,565 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-17 22:10:02,565 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-17 22:10:02,567 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-17 22:10:02,567 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-17 22:10:02,567 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-17 22:10:02,567 - __main__ - INFO - Running 2 scrapers concurrently...
2026-06-17 22:10:02,567 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-17 22:10:03,136 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-17 22:10:03,219 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-17 22:10:03,878 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: honestly how are you guys paying for all these api calls
2026-06-17 22:10:03,894 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Desktop update broke my macOS launcher, but my data was still i
2026-06-17 22:10:03,905 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How's your experience with long running goal?
2026-06-17 22:10:04,416 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-17 22:10:05,065 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 3
2026-06-17 22:10:05,065 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-17 22:10:05,065 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-17 22:10:05,065 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-17 22:10:05,218 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-17 22:10:05,674 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-17 22:10:06,218 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-17 22:10:06,218 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-17 22:10:06,218 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-17 22:10:06,219 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-17 22:10:06,369 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-17 22:10:06,642 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.
2026-06-17 22:10:06,643 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-17 22:10:07,017 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-17 22:10:07,370 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-17 22:10:07,370 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-17 22:10:07,370 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-17 22:10:07,370 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-17 22:10:08,524 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-17 22:10:09,674 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-17 22:10:10,825 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-17 22:10:11,977 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-17 22:10:11,977 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-17 22:10:13,129 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-17 22:10:14,283 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-17 22:10:15,427 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-17 22:10:15,427 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-17 22:10:16,580 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-17 22:10:16,580 - __main__ - INFO - Scraper reddit completed: 3 results
2026-06-17 22:10:17,215 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Chaim Kohn - We spend $20,000 on this every year.
Flights
Hotels
Meals
Events
On paper, it's hard to justif
2026-06-17 22:10:17,225 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Nussi Einhorn - Designersโฆ this is our moment ๐
Iโm looking at a real native Mac app weโre prototyping right now an
2026-06-17 22:10:17,237 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Moses Lebovits - Importers across the nation are actively filing their IEEPA refund claims
following the V.O.S. Sel
2026-06-17 22:10:17,247 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Moishe Goldstein - I used to think moving fast was everything.
Get the deal done. Get the approval through. Get the re
2026-06-17 22:10:17,261 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Aron Mann - If you're not paying your taxes, why would I trust you to pay me?
That is how a lender thinks.
H
2026-06-17 22:10:17,268 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ezra Lebowitz - My wife Rachel Lebowitz might be trolling me,
But I check the scrap bins myself.
If weโre throwin
2026-06-17 22:10:17,285 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-17 22:10:17.285282
2026-06-17 22:10:17,285 - __main__ - INFO - Email sent successfully
2026-06-17 22:10:17,285 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-17 22:10:17,286 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new reddit results.
2026-06-17 22:10:17,286 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-17 22:10:17,286 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 22:10:17,286 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-17 22:10:17,287 - __main__ - INFO - Closed all database connections
2026-06-17 22:10:17,287 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 22:10:17,287 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-17 22:10:17,345 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Berel Solomon - We had a massive flood in our office, so much got destroyed.
They had to relocate us to a different
2026-06-17 22:10:17,397 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 7 new posts.
2026-06-17 22:10:17,398 - __main__ - INFO - Scraper linkedin completed: 0 results
2026-06-17 22:10:17,398 - __main__ - INFO - Scraper linkedin_feed completed: 7 results
2026-06-17 22:10:18,097 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-17 22:10:18.097620
2026-06-17 22:10:18,097 - __main__ - INFO - Email sent successfully
2026-06-17 22:10:18,097 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-17 22:10:18,098 - __main__ - INFO - Monitor complete. Found 7 total results: 7 new linkedin feed results.
2026-06-17 22:10:18,098 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-17 22:10:18,098 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 22:10:18,201 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-17 22:10:18,201 - __main__ - INFO - Closed all database connections
2026-06-17 22:10:18,202 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 22:10:18,202 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-17 22:30:02,368 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-17.log
2026-06-17 22:30:02,368 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-17.log
2026-06-17 22:30:02,368 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-17.log
2026-06-17 22:30:02,368 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-17 22:30:02,394 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-17 22:30:02,394 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-17 22:30:02,394 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-17 22:30:02,397 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-17 22:30:02,397 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-17 22:30:02,409 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-17 22:30:02,409 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-17 22:30:02,410 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-17 22:30:02,410 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-17 22:30:02,410 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-17 22:30:02,411 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-17 22:30:02,413 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-17 22:30:02,413 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-17 22:30:02,416 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-17 22:30:02,421 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-17 22:30:02,421 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-17 22:30:02,424 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-17 22:30:02,424 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-17 22:30:02,425 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-17 22:30:02,425 - __main__ - INFO - Running 2 scrapers concurrently...
2026-06-17 22:30:02,425 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-17 22:30:02,524 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-17 22:30:02,991 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-17 22:30:17,409 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-17 22:30:31,654 - TwitterScraper - INFO - Twitter/X RSS: 96 entries for 'multica'
2026-06-17 22:30:44,800 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-17 22:30:46,026 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-17 22:30:46,111 - GitHubScraper - INFO - Found 240 GitHub repositories for term: paperclip
2026-06-17 22:30:46,145 - GitHubScraper - INFO - Added new GitHub repository: Unreal-Agent
2026-06-17 22:30:47,350 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-17 22:30:47,353 - GitHubScraper - INFO - Found 373 GitHub repositories for term: "Hermes Agent"
2026-06-17 22:30:48,421 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-17 22:30:48,425 - GitHubScraper - INFO - Found 52 GitHub repositories for term: multica
2026-06-17 22:30:48,552 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-17 22:30:48,553 - __main__ - INFO - Scraper github completed: 1 results
2026-06-17 22:30:48,553 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-17 22:30:49,200 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-17 22:30:49.199953
2026-06-17 22:30:49,200 - __main__ - INFO - Email sent successfully
2026-06-17 22:30:49,200 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-17 22:30:49,200 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new github results.
2026-06-17 22:30:49,200 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-17 22:30:49,200 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 22:30:49,215 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-17 22:30:49,215 - __main__ - INFO - Closed all database connections
2026-06-17 22:30:49,218 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 22:30:49,218 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-17 23:00:02,189 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-17.log
2026-06-17 23:00:02,189 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-17.log
2026-06-17 23:00:02,189 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-17.log
2026-06-17 23:00:02,189 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-17 23:00:02,217 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-17 23:00:02,217 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-17 23:00:02,219 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-17 23:00:02,220 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-17 23:00:02,369 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-17 23:00:02,369 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-17 23:00:02,371 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-17 23:00:02,373 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-17 23:00:02,373 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-17 23:00:02,378 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-17 23:00:02,378 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-17 23:00:02,378 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-17 23:00:02,383 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-17 23:00:02,392 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-17 23:00:02,392 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-17 23:00:02,396 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-17 23:00:02,396 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-17 23:00:02,397 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-17 23:00:02,397 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-17 23:00:02,397 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-17 23:00:02,397 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-17 23:00:02,495 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-17 23:00:02,500 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-17 23:00:02,500 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-17 23:00:02,501 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-17 23:00:02,784 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-17 23:00:03,156 - RSSFeedScraper - INFO - Total RSS/HTML results: 2
2026-06-17 23:00:08,716 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-17 23:00:08,941 - Yiddish24Scraper - INFO - Received response with 486045 characters
2026-06-17 23:00:08,946 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (307987 chars)
2026-06-17 23:00:08,949 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-17 23:00:09,042 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-17 23:00:09,083 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-17 23:00:09,083 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-17 23:00:09,112 - Yiddish24Scraper - INFO - Term 'ืืื ืกืคืืจืืฆืืข -' matched in DESCRIPTION: 'ืืื ืกืคืืจืืฆืืข - ื ืื ื ืคืืืืขืจ ืืืกื ืืื ืืขืื'
2026-06-17 23:00:09,112 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-06-17 23:00:09,880 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/INSPIRATION_weiss_260_260617055027.mp3
2026-06-17 23:00:10,049 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_INSPIRATION_weiss_260_260617055027.mp3 (4.5 MB)
2026-06-17 23:00:10,051 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-17 23:00:10,065 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_INSPIRATION_weiss_260_260617055027.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-17 23:00:10,066 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_INSPIRATION_weiss_260_260617055027_ืืื ืกืคืืจืืฆืืข_-.mp3
2026-06-17 23:00:10,729 - Yiddish24Scraper - INFO - Page 1 summary: 7 new out of 100 total articles
2026-06-17 23:00:10,729 - Yiddish24Scraper - INFO - Page 1: 7/100 new items
2026-06-17 23:00:10,729 - Yiddish24Scraper - INFO - Low new item ratio (7.0%), stopping pagination
2026-06-17 23:00:10,729 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 7
2026-06-17 23:00:14,093 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-17 23:00:42,371 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 21 new posts.
2026-06-17 23:00:42,371 - __main__ - INFO - Scraper rss completed: 2 results
2026-06-17 23:00:42,371 - __main__ - INFO - Scraper yiddish24 completed: 7 results
2026-06-17 23:00:42,371 - __main__ - INFO - Scraper ivelt completed: 21 results
2026-06-17 23:00:43,180 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-17 23:00:43.180078
2026-06-17 23:00:43,180 - __main__ - INFO - Email sent successfully
2026-06-17 23:00:43,180 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-17 23:00:43,180 - __main__ - INFO - Monitor complete. Found 30 total results: 2 new rss results, 7 new yiddish24 results, 21 new ivelt results.
2026-06-17 23:00:43,180 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-17 23:00:43,181 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 23:00:43,272 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-17 23:00:43,272 - __main__ - INFO - Closed all database connections
2026-06-17 23:00:43,275 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 23:00:43,275 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-17 23:10:02,516 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-17.log
2026-06-17 23:10:02,516 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-17.log
2026-06-17 23:10:02,516 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-17.log
2026-06-17 23:10:02,516 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-17 23:10:02,529 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-17.log
2026-06-17 23:10:02,529 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-17.log
2026-06-17 23:10:02,529 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-17.log
2026-06-17 23:10:02,529 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-17 23:10:02,539 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-17 23:10:02,540 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-17 23:10:02,542 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-17 23:10:02,542 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-17 23:10:02,553 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-17 23:10:02,553 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-17 23:10:02,555 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-17 23:10:02,556 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-17 23:10:02,556 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-17 23:10:02,569 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-17 23:10:02,581 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-17 23:10:02,581 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-17 23:10:02,603 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-17 23:10:02,603 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-17 23:10:02,603 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-17 23:10:02,606 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-17 23:10:02,606 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-17 23:10:02,608 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-17 23:10:02,613 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-17 23:10:02,613 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-17 23:10:02,615 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-17 23:10:02,615 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-17 23:10:02,615 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-17 23:10:02,615 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-17 23:10:02,615 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-17 23:10:02,615 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-17 23:10:02,624 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-17 23:10:02,624 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-17 23:10:02,625 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-17 23:10:02,625 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-17 23:10:02,627 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-17 23:10:02,627 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-17 23:10:02,629 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-17 23:10:02,634 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-17 23:10:02,634 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-17 23:10:02,636 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-17 23:10:02,636 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-17 23:10:02,636 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-17 23:10:02,636 - __main__ - INFO - Running 2 scrapers concurrently...
2026-06-17 23:10:02,636 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-17 23:10:03,060 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-17 23:10:03,421 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-17 23:10:03,457 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Dont use DeepSeek through OpenRouter
2026-06-17 23:10:04,352 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-17 23:10:04,983 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-06-17 23:10:04,983 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-17 23:10:04,983 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-17 23:10:04,984 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-17 23:10:05,128 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-17 23:10:05,647 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-17 23:10:06,114 - LinkedInScraper - INFO - New LinkedIn post: GitHub - MrCipherSmith/goodai-base: Shared knowledge base for AI codin
2026-06-17 23:10:06,128 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-17 23:10:06,129 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-17 23:10:06,129 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-17 23:10:06,129 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-17 23:10:06,189 - LinkedInScraper - INFO - New LinkedIn post: Claude Code Is Powerful. Without These 7 Skills, Itโs Also Unreliable.
2026-06-17 23:10:06,280 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-17 23:10:06,342 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.
2026-06-17 23:10:06,343 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-17 23:10:06,951 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-17 23:10:07,281 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-17 23:10:07,281 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-17 23:10:07,281 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-17 23:10:07,281 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-17 23:10:08,435 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-17 23:10:09,584 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-17 23:10:10,738 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-17 23:10:11,887 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-17 23:10:11,888 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-17 23:10:13,043 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-17 23:10:13,618 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Rob Waxman CEO Swag Merch Thirty Eight Years - Pincus Schiff saved a business 80 percent.
Just call Friday and see how much you can save .
I am n
2026-06-17 23:10:13,629 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ari Koth - ๐๐ง๐ ๐จ๐ ๐ญ๐ก๐ ๐ฆ๐จ๐ฌ๐ญ ๐ซ๐๐ฐ๐๐ซ๐๐ข๐ง๐ ๐ฉ๐๐ซ๐ญ๐ฌ ๐จ๐ ๐ญ๐ก๐ ๐ฉ๐ซ๐จ๐๐๐ฌ๐ฌ.
After months of planning, coordination, and countle
2026-06-17 23:10:13,658 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Tom Hacohen - This week I had the displeasure of consuming webhooks from a non Standard Webhooks compatible implem
2026-06-17 23:10:13,672 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Tuvia Kopstein - Meeting Yosef Golubchik in his Edison office yesterday gave me enough adrenaline to last the next fe
2026-06-17 23:10:13,741 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 4 new posts.
2026-06-17 23:10:13,741 - __main__ - INFO - Scraper linkedin completed: 2 results
2026-06-17 23:10:13,741 - __main__ - INFO - Scraper linkedin_feed completed: 4 results
2026-06-17 23:10:14,201 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-17 23:10:14,367 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-17 23:10:14.367401
2026-06-17 23:10:14,367 - __main__ - INFO - Email sent successfully
2026-06-17 23:10:14,368 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-17 23:10:14,368 - __main__ - INFO - Monitor complete. Found 6 total results: 2 new linkedin results, 4 new linkedin feed results.
2026-06-17 23:10:14,368 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-17 23:10:14,368 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 23:10:14,369 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-17 23:10:14,369 - __main__ - INFO - Closed all database connections
2026-06-17 23:10:14,370 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 23:10:14,370 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-17 23:10:15,345 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-17 23:10:15,345 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-17 23:10:16,498 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-17 23:10:16,499 - __main__ - INFO - Scraper reddit completed: 1 results
2026-06-17 23:10:17,024 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-17 23:10:17.024776
2026-06-17 23:10:17,025 - __main__ - INFO - Email sent successfully
2026-06-17 23:10:17,025 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-17 23:10:17,025 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new reddit results.
2026-06-17 23:10:17,025 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-17 23:10:17,025 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 23:10:17,124 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-17 23:10:17,125 - __main__ - INFO - Closed all database connections
2026-06-17 23:10:17,125 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-17 23:10:17,125 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...