← Logs

social_media_monitor_2026-05-23.log

2026-05-23 18:45:02,491 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-23 18:45:02,493 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-23 18:45:02,493 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-23 18:45:02,493 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-23 18:45:02,493 - __main__ - INFO - Running 1 scrapers concurrently...
2026-05-23 18:45:02,493 - AhBlickLiveScraper - INFO - Starting AhBlickLive scraping from 1 URL(s)
2026-05-23 18:45:02,601 - AhBlickLiveScraper - INFO - Fetching: https://ahblicklive.com/load_video.php
2026-05-23 18:45:02,963 - httpx - INFO - HTTP Request: GET https://ahblicklive.com/load_video.php "HTTP/1.1 200 OK"
2026-05-23 18:45:02,964 - AhBlickLiveScraper - INFO - Received response with 27688 characters
2026-05-23 18:45:02,971 - AhBlickLiveScraper - INFO - Parsed 11 videos from https://ahblicklive.com/load_video.php
2026-05-23 18:45:03,074 - AhBlickLiveScraper - INFO - Total AhBlickLive results: 0
2026-05-23 18:45:03,074 - __main__ - INFO - Scraper ahblicklive completed: 0 results
2026-05-23 18:45:03,074 - __main__ - INFO - No new results found across all enabled sources
2026-05-23 18:45:03,074 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-23 18:45:03,074 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-05-23 18:45:03,074 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-23 18:45:03,074 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 18:45:03,096 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-23 18:45:03,096 - __main__ - INFO - Closed all database connections
2026-05-23 18:45:03,097 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 18:45:03,097 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-23 19:00:02,184 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-23.log
2026-05-23 19:00:02,185 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-23.log
2026-05-23 19:00:02,185 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-23.log
2026-05-23 19:00:02,186 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-23 19:00:02,209 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-23 19:00:02,209 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-23 19:00:02,211 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-23 19:00:02,212 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-23 19:00:02,509 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-23 19:00:02,510 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-23 19:00:02,512 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-23 19:00:02,513 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-23 19:00:02,513 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-23 19:00:02,519 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-23 19:00:02,520 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-23 19:00:02,520 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-23 19:00:02,542 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-23 19:00:02,550 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-23 19:00:02,550 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-23 19:00:02,553 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-23 19:00:02,553 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-23 19:00:02,553 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-23 19:00:02,553 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-23 19:00:02,553 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-23 19:00:02,554 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-23 19:00:02,665 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-23 19:00:02,673 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-23 19:00:02,674 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-23 19:00:02,675 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-23 19:00:03,058 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-23 19:00:03,525 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-23 19:00:03,955 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-23 19:00:04,179 - Yiddish24Scraper - INFO - Received response with 493044 characters
2026-05-23 19:00:04,183 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313604 chars)
2026-05-23 19:00:04,187 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-23 19:00:04,277 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-23 19:00:04,321 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-23 19:00:04,321 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-23 19:00:05,219 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-23 19:00:05,219 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-23 19:00:05,219 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-23 19:00:05,220 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-23 19:00:15,007 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-23 19:00:25,039 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 0 new posts.
2026-05-23 19:00:25,039 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-23 19:00:25,040 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-23 19:00:25,040 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-23 19:00:25,790 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-23 19:00:25.790104
2026-05-23 19:00:25,790 - __main__ - INFO - Email sent successfully
2026-05-23 19:00:25,790 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-23 19:00:25,790 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-05-23 19:00:25,790 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-23 19:00:25,790 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 19:00:25,863 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-23 19:00:25,863 - __main__ - INFO - Closed all database connections
2026-05-23 19:00:25,865 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 19:00:25,865 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-23 20:00:02,236 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-23.log
2026-05-23 20:00:02,236 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-23.log
2026-05-23 20:00:02,236 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-23.log
2026-05-23 20:00:02,236 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-23 20:00:02,260 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-23 20:00:02,260 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-23 20:00:02,264 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-23 20:00:02,271 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-23 20:00:02,336 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-23 20:00:02,336 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-23 20:00:02,399 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-23 20:00:02,402 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-23 20:00:02,402 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-23 20:00:02,427 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-23 20:00:02,427 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-23 20:00:02,427 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-23 20:00:02,432 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-23 20:00:02,436 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-23 20:00:02,436 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-23 20:00:02,438 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-23 20:00:02,438 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-23 20:00:02,438 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-23 20:00:02,438 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-23 20:00:02,438 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-23 20:00:02,439 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-23 20:00:02,586 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-23 20:00:02,591 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-23 20:00:02,591 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-23 20:00:02,594 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-23 20:00:02,954 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-23 20:00:03,405 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-23 20:00:03,919 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-23 20:00:04,160 - Yiddish24Scraper - INFO - Received response with 493044 characters
2026-05-23 20:00:04,164 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313604 chars)
2026-05-23 20:00:04,169 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-23 20:00:04,255 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-23 20:00:04,294 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-23 20:00:04,294 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-23 20:00:05,223 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-23 20:00:05,223 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-23 20:00:05,223 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-23 20:00:05,224 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-23 20:00:14,274 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-23 20:00:23,084 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 0 new posts.
2026-05-23 20:00:23,084 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-23 20:00:23,084 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-23 20:00:23,084 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-23 20:00:23,759 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-23 20:00:23.759050
2026-05-23 20:00:23,759 - __main__ - INFO - Email sent successfully
2026-05-23 20:00:23,759 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-23 20:00:23,759 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-05-23 20:00:23,759 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-23 20:00:23,759 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 20:00:23,854 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-23 20:00:23,854 - __main__ - INFO - Closed all database connections
2026-05-23 20:00:23,856 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 20:00:23,856 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-23 20:30:02,465 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-23.log
2026-05-23 20:30:02,466 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-23.log
2026-05-23 20:30:02,466 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-23.log
2026-05-23 20:30:02,466 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-23 20:30:02,491 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-23 20:30:02,491 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-23 20:30:02,491 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-23 20:30:02,493 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-23 20:30:02,494 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-23 20:30:02,583 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-23 20:30:02,583 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-23 20:30:02,585 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-23 20:30:02,585 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-23 20:30:02,586 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-23 20:30:02,586 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-23 20:30:02,587 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-23 20:30:02,587 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-23 20:30:02,588 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-23 20:30:02,594 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-23 20:30:02,594 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-23 20:30:02,616 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-23 20:30:02,623 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-23 20:30:02,623 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-23 20:30:02,625 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-23 20:30:02,625 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-23 20:30:02,625 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-23 20:30:02,625 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-23 20:30:02,625 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-23 20:30:02,625 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-23 20:30:03,465 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-23 20:30:03,796 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Playwright version that lets Hermes Agents navigate the web
2026-05-23 20:30:03,811 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent memory tip: Local AI models without the stale context tra
2026-05-23 20:30:05,043 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-05-23 20:30:05,043 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-23 20:30:05,043 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-23 20:30:05,043 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-23 20:30:06,314 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-23 20:30:06,360 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Before Claude, we had this guy in 2003.. do you remember him?
2026-05-23 20:30:07,630 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-23 20:30:07,630 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-23 20:30:07,630 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-23 20:30:07,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-23 20:30:08,633 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-23 20:30:09,931 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-23 20:30:09,931 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-23 20:30:09,931 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-23 20:30:09,932 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-23 20:30:10,918 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Building /Optimizing Hermes
2026-05-23 20:30:12,115 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-23 20:30:14,627 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-23 20:30:16,035 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AnimationThrowdown: CM Review 5/23/2026
2026-05-23 20:30:17,259 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-23 20:30:19,044 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-23 20:30:19,044 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-23 20:30:21,411 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-23 20:30:23,642 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-23 20:30:25,702 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-05-23 20:30:25,702 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-23 20:30:27,759 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 2
2026-05-23 20:30:27,759 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-23 20:30:27,898 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-23 20:30:28,335 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-23 20:30:42,476 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-23 20:30:55,162 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-23 20:31:07,285 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-23 20:31:07,286 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-23 20:31:07,992 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-23 20:31:09,351 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-23 20:31:09,711 - LinkedInScraper - INFO - New LinkedIn post: Unified Cowork platform for OpenClaw, Hermes Agent & Claude Code! Aion
2026-05-23 20:31:10,814 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-23 20:31:11,742 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 1 new results.
2026-05-23 20:31:11,743 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-23 20:31:18,704 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-23 20:31:18,795 - GitHubScraper - INFO - Found 232 GitHub repositories for term: paperclip
2026-05-23 20:31:19,858 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-23 20:31:19,862 - GitHubScraper - INFO - Found 274 GitHub repositories for term: "Hermes Agent"
2026-05-23 20:31:20,770 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-23 20:31:20,772 - GitHubScraper - INFO - Found 49 GitHub repositories for term: multica
2026-05-23 20:31:20,929 - GitHubScraper - INFO - Total GitHub results found: 0
2026-05-23 20:31:20,929 - __main__ - INFO - Scraper reddit completed: 5 results
2026-05-23 20:31:20,929 - __main__ - INFO - Scraper github completed: 0 results
2026-05-23 20:31:20,929 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-23 20:31:20,929 - __main__ - INFO - Scraper linkedin completed: 1 results
2026-05-23 20:31:20,930 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-23 20:31:21,505 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-23 20:31:21.505201
2026-05-23 20:31:21,505 - __main__ - INFO - Email sent successfully
2026-05-23 20:31:21,505 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-23 20:31:21,506 - __main__ - INFO - Monitor complete. Found 6 total results: 5 new reddit results, 1 new linkedin results.
2026-05-23 20:31:21,506 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-23 20:31:21,506 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 20:31:21,630 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-23 20:31:21,631 - __main__ - INFO - Closed all database connections
2026-05-23 20:31:21,669 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 20:31:21,684 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-23 21:00:02,532 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-23.log
2026-05-23 21:00:02,533 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-23.log
2026-05-23 21:00:02,533 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-23.log
2026-05-23 21:00:02,533 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-23 21:00:02,557 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-23 21:00:02,557 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-23 21:00:02,559 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-23 21:00:02,559 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-23 21:00:02,719 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-23 21:00:02,719 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-23 21:00:02,777 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-23 21:00:02,778 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-23 21:00:02,778 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-23 21:00:02,803 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-23 21:00:02,803 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-23 21:00:02,803 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-23 21:00:02,807 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-23 21:00:02,812 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-23 21:00:02,812 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-23 21:00:02,814 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-23 21:00:02,814 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-23 21:00:02,814 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-23 21:00:02,814 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-23 21:00:02,814 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-23 21:00:02,814 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-23 21:00:02,895 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-23 21:00:02,902 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-23 21:00:02,903 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-23 21:00:02,904 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-23 21:00:03,213 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-23 21:00:03,746 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-05-23 21:00:04,144 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-23 21:00:04,355 - Yiddish24Scraper - INFO - Received response with 493044 characters
2026-05-23 21:00:04,358 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313604 chars)
2026-05-23 21:00:04,363 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-23 21:00:04,448 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-23 21:00:04,489 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-23 21:00:04,489 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-23 21:00:05,542 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-23 21:00:05,542 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-23 21:00:05,542 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-23 21:00:05,543 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-23 21:00:14,892 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-23 21:00:23,759 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 0 new posts.
2026-05-23 21:00:23,759 - __main__ - INFO - Scraper rss completed: 4 results
2026-05-23 21:00:23,759 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-23 21:00:23,759 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-23 21:00:24,452 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-23 21:00:24.452876
2026-05-23 21:00:24,453 - __main__ - INFO - Email sent successfully
2026-05-23 21:00:24,453 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-23 21:00:24,453 - __main__ - INFO - Monitor complete. Found 4 total results: 4 new rss results.
2026-05-23 21:00:24,453 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-23 21:00:24,453 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 21:00:24,520 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-23 21:00:24,521 - __main__ - INFO - Closed all database connections
2026-05-23 21:00:24,522 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 21:00:24,522 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-23 22:00:02,221 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-23.log
2026-05-23 22:00:02,223 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-23.log
2026-05-23 22:00:02,224 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-23.log
2026-05-23 22:00:02,224 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-23 22:00:02,248 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-23 22:00:02,248 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-23 22:00:02,259 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-23 22:00:02,264 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-23 22:00:02,492 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-23 22:00:02,492 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-23 22:00:02,494 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-23 22:00:02,500 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-23 22:00:02,500 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-23 22:00:02,506 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-23 22:00:02,506 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-23 22:00:02,506 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-23 22:00:02,535 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-23 22:00:02,543 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-23 22:00:02,543 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-23 22:00:02,545 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-23 22:00:02,545 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-23 22:00:02,545 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-23 22:00:02,545 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-23 22:00:02,545 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-23 22:00:02,545 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-23 22:00:02,738 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-23 22:00:02,747 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-23 22:00:02,747 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-23 22:00:02,748 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-23 22:00:03,358 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-23 22:00:03,895 - RSSFeedScraper - INFO - Total RSS/HTML results: 2
2026-05-23 22:00:04,338 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-23 22:00:04,565 - Yiddish24Scraper - INFO - Received response with 493044 characters
2026-05-23 22:00:04,567 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313604 chars)
2026-05-23 22:00:04,572 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-23 22:00:04,671 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-23 22:00:04,726 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-23 22:00:04,726 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-23 22:00:05,684 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-23 22:00:05,684 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-23 22:00:05,684 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-23 22:00:05,685 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-23 22:00:14,293 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-23 22:00:25,225 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 0 new posts.
2026-05-23 22:00:25,226 - __main__ - INFO - Scraper rss completed: 2 results
2026-05-23 22:00:25,226 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-23 22:00:25,226 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-23 22:00:26,754 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-23 22:00:26.754709
2026-05-23 22:00:26,755 - __main__ - INFO - Email sent successfully
2026-05-23 22:00:26,755 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-23 22:00:26,755 - __main__ - INFO - Monitor complete. Found 2 total results: 2 new rss results.
2026-05-23 22:00:26,755 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-23 22:00:26,755 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 22:00:26,797 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-23 22:00:26,798 - __main__ - INFO - Closed all database connections
2026-05-23 22:00:26,800 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 22:00:26,800 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-23 22:30:02,932 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-23.log
2026-05-23 22:30:02,933 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-23.log
2026-05-23 22:30:02,933 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-23.log
2026-05-23 22:30:02,933 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-23 22:30:02,974 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-23 22:30:02,974 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-23 22:30:02,974 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-23 22:30:02,976 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-23 22:30:02,982 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-23 22:30:03,252 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-23 22:30:03,253 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-23 22:30:03,311 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-23 22:30:03,311 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-23 22:30:03,311 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-23 22:30:03,311 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-23 22:30:03,313 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-23 22:30:03,314 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-23 22:30:03,314 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-23 22:30:03,339 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-23 22:30:03,339 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-23 22:30:03,342 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-23 22:30:03,346 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-23 22:30:03,346 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-23 22:30:03,348 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-23 22:30:03,348 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-23 22:30:03,348 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-23 22:30:03,348 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-23 22:30:03,348 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-23 22:30:03,348 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-23 22:30:04,351 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-23 22:30:04,469 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Am I missing something or Hermes is just not for me?
2026-05-23 22:30:04,499 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent model routing guide: Local AI models without the stronges
2026-05-23 22:30:04,515 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Mercury Agent install note: Mercury background tasks without the setup
2026-05-23 22:30:04,539 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: The 10 fastest growing GitHub repos this week:
2026-05-23 22:30:04,558 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Top 10 Fastest Growing AI repos this week
2026-05-23 22:30:04,573 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Modern version of "Hackers" and "War Games" and "Sneakers" mashup (AI
2026-05-23 22:30:05,760 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 6
2026-05-23 22:30:05,760 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-23 22:30:05,760 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-23 22:30:05,760 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-23 22:30:06,780 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-23 22:30:06,823 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Clippy, the paperclip that lived on every PC in the early 2000s
2026-05-23 22:30:08,124 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-23 22:30:08,125 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-23 22:30:08,125 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-23 22:30:08,125 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-23 22:30:08,974 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-23 22:30:10,275 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-23 22:30:10,276 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-23 22:30:10,276 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-23 22:30:10,276 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-23 22:30:12,248 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-23 22:30:13,183 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Creating a stable workflow?
2026-05-23 22:30:13,198 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/homelab: Finally found a way to utilize my server's compute (parallel Qwen3-30B
2026-05-23 22:30:14,288 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-23 22:30:16,641 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-23 22:30:18,578 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-23 22:30:18,578 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-23 22:30:21,063 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-23 22:30:23,093 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-23 22:30:25,143 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-05-23 22:30:25,144 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-23 22:30:27,233 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 2
2026-05-23 22:30:27,233 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-23 22:30:27,440 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-23 22:30:27,904 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-23 22:30:41,620 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-23 22:30:53,672 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-23 22:31:05,611 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-23 22:31:05,612 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-23 22:31:06,195 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-23 22:31:06,285 - LinkedInScraper - INFO - New LinkedIn post: I spent two months evaluating OpenClaw, Hermes, and Paperclip. I now c
2026-05-23 22:31:07,464 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-23 22:31:07,801 - LinkedInScraper - INFO - New LinkedIn post: How interesting, testing Hermes Agent from Nous Research on a Raspi 5
2026-05-23 22:31:08,800 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-23 22:31:09,020 - LinkedInScraper - INFO - New LinkedIn post: The Five Surfaces: What Anthropic Is Actually Building Behind Managed
2026-05-23 22:31:09,784 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 3 new results.
2026-05-23 22:31:09,784 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-23 22:31:13,688 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-23 22:31:13,712 - GitHubScraper - INFO - Found 232 GitHub repositories for term: paperclip
2026-05-23 22:31:14,712 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-23 22:31:14,715 - GitHubScraper - INFO - Found 275 GitHub repositories for term: "Hermes Agent"
2026-05-23 22:31:15,703 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-23 22:31:15,707 - GitHubScraper - INFO - Found 49 GitHub repositories for term: multica
2026-05-23 22:31:15,877 - GitHubScraper - INFO - Total GitHub results found: 0
2026-05-23 22:31:15,878 - __main__ - INFO - Scraper reddit completed: 9 results
2026-05-23 22:31:15,878 - __main__ - INFO - Scraper github completed: 0 results
2026-05-23 22:31:15,878 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-23 22:31:15,878 - __main__ - INFO - Scraper linkedin completed: 3 results
2026-05-23 22:31:15,878 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-23 22:31:16,657 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-23 22:31:16.657021
2026-05-23 22:31:16,657 - __main__ - INFO - Email sent successfully
2026-05-23 22:31:16,657 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-23 22:31:16,657 - __main__ - INFO - Monitor complete. Found 12 total results: 9 new reddit results, 3 new linkedin results.
2026-05-23 22:31:16,657 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-23 22:31:16,657 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 22:31:16,758 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-23 22:31:16,758 - __main__ - INFO - Closed all database connections
2026-05-23 22:31:16,795 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 22:31:16,812 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-23 23:00:01,753 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-23.log
2026-05-23 23:00:01,754 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-23.log
2026-05-23 23:00:01,754 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-23.log
2026-05-23 23:00:01,754 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-23 23:00:01,786 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-23 23:00:01,786 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-23 23:00:01,790 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-23 23:00:01,790 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-23 23:00:02,135 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-23 23:00:02,135 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-23 23:00:02,137 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-23 23:00:02,139 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-23 23:00:02,139 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-23 23:00:02,145 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-23 23:00:02,145 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-23 23:00:02,145 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-23 23:00:02,172 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-23 23:00:02,181 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-23 23:00:02,181 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-23 23:00:02,186 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-23 23:00:02,186 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-23 23:00:02,186 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-23 23:00:02,186 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-23 23:00:02,186 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-23 23:00:02,187 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-23 23:00:02,275 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-23 23:00:02,283 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-23 23:00:02,283 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-23 23:00:02,284 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-23 23:00:02,697 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-23 23:00:03,195 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-23 23:00:03,618 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-23 23:00:03,844 - Yiddish24Scraper - INFO - Received response with 493044 characters
2026-05-23 23:00:03,847 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313604 chars)
2026-05-23 23:00:03,852 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-23 23:00:03,943 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-23 23:00:03,983 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-23 23:00:03,983 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-23 23:00:05,234 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-23 23:00:05,234 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-23 23:00:05,234 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-23 23:00:05,234 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-23 23:00:14,213 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-23 23:00:25,644 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 1 new posts.
2026-05-23 23:00:25,644 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-23 23:00:25,644 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-23 23:00:25,644 - __main__ - INFO - Scraper ivelt completed: 1 results
2026-05-23 23:00:27,051 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-23 23:00:27.051842
2026-05-23 23:00:27,052 - __main__ - INFO - Email sent successfully
2026-05-23 23:00:27,052 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-23 23:00:27,052 - __main__ - INFO - Monitor complete. Found 4 total results: 3 new rss results, 1 new ivelt results.
2026-05-23 23:00:27,052 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-23 23:00:27,052 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 23:00:27,101 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-23 23:00:27,101 - __main__ - INFO - Closed all database connections
2026-05-23 23:00:27,102 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-23 23:00:27,106 - social_media_monitor.database.connection - INFO - Closed 0 database connections