โ Logs
social_media_monitor_2026-06-09.log
2026-06-09 19:00:01,981 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-09 19:00:01,981 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-09 19:00:01,983 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-09 19:00:01,988 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-09 19:00:01,988 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=4
2026-06-09 19:00:01,990 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-09 19:00:01,990 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-09 19:00:01,990 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-09 19:00:01,990 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-09 19:00:01,990 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-09 19:00:01,990 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-09 19:00:02,083 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-09 19:00:02,089 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-09 19:00:02,089 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-09 19:00:02,090 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-09 19:00:03,156 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-09 19:00:03,665 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-09 19:00:07,130 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-09 19:00:07,340 - Yiddish24Scraper - INFO - Received response with 461627 characters
2026-06-09 19:00:07,343 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (298393 chars)
2026-06-09 19:00:07,346 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-09 19:00:07,430 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-09 19:00:07,474 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-09 19:00:07,475 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-09 19:00:07,545 - Yiddish24Scraper - INFO - Term 'ืืง ืืืฉืจืื' matched in TITLE: 'ืืง ืืืฉืจืื - ืืจื ืืืื ืืขืืืืืืืฉ'
2026-06-09 19:00:07,545 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืง ืืืฉืจืื - ืืจื ืืืื ืืขืืืืืืืฉ
2026-06-09 19:00:08,352 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/20260609014438-158119.mp3
2026-06-09 19:00:10,639 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_20260609014438-158119.mp3 (47.4 MB)
2026-06-09 19:00:10,641 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-09 19:00:10,663 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_20260609014438-158119.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-09 19:00:10,664 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_20260609014438-158119_ืืง_ืืืฉืจืื.mp3
2026-06-09 19:00:11,295 - Yiddish24Scraper - INFO - Page 1 summary: 8 new out of 100 total articles
2026-06-09 19:00:11,296 - Yiddish24Scraper - INFO - Page 1: 8/100 new items
2026-06-09 19:00:11,296 - Yiddish24Scraper - INFO - Low new item ratio (8.0%), stopping pagination
2026-06-09 19:00:11,296 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 8
2026-06-09 19:00:13,744 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-09 19:00:34,705 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-06-09 19:00:34,705 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-09 19:00:35,825 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-09 19:00:50,893 - IveltScraper - INFO - yidtish scrape complete. Checked 2 topics.
2026-06-09 19:00:50,894 - IveltScraper - INFO - All forums scrape complete. Found 23 new posts.
2026-06-09 19:00:50,894 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-09 19:00:50,895 - __main__ - INFO - Scraper yiddish24 completed: 8 results
2026-06-09 19:00:50,895 - __main__ - INFO - Scraper ivelt completed: 23 results
2026-06-09 19:00:52,606 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-09 19:00:52.606057
2026-06-09 19:00:52,608 - __main__ - INFO - Email sent successfully
2026-06-09 19:00:52,608 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-09 19:00:52,608 - __main__ - INFO - Monitor complete. Found 34 total results: 3 new rss results, 8 new yiddish24 results, 23 new ivelt results.
2026-06-09 19:00:52,608 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-09 19:00:52,608 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 19:00:52,666 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-09 19:00:52,667 - __main__ - INFO - Closed all database connections
2026-06-09 19:00:52,670 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 19:00:52,670 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-09 20:00:02,215 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-09.log
2026-06-09 20:00:02,215 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-09.log
2026-06-09 20:00:02,215 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-09.log
2026-06-09 20:00:02,215 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-09 20:00:02,267 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-09 20:00:02,267 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-09 20:00:02,269 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-09 20:00:02,270 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-09 20:00:02,288 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-09 20:00:02,288 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-09 20:00:02,335 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-09 20:00:02,336 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-09 20:00:02,336 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-09 20:00:02,339 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-09 20:00:02,339 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-09 20:00:02,339 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-09 20:00:02,341 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-09 20:00:02,346 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-09 20:00:02,346 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=4
2026-06-09 20:00:02,348 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-09 20:00:02,348 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-09 20:00:02,348 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-09 20:00:02,348 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-09 20:00:02,348 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-09 20:00:02,348 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-09 20:00:02,432 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-09 20:00:02,437 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-09 20:00:02,437 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-09 20:00:02,438 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-09 20:00:02,717 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-09 20:00:03,415 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-09 20:00:07,288 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-09 20:00:07,503 - Yiddish24Scraper - INFO - Received response with 475332 characters
2026-06-09 20:00:07,506 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (304816 chars)
2026-06-09 20:00:07,509 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-09 20:00:07,594 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-09 20:00:07,643 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-09 20:00:07,643 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-09 20:00:08,584 - Yiddish24Scraper - INFO - Page 1 summary: 8 new out of 100 total articles
2026-06-09 20:00:08,584 - Yiddish24Scraper - INFO - Page 1: 8/100 new items
2026-06-09 20:00:08,584 - Yiddish24Scraper - INFO - Low new item ratio (8.0%), stopping pagination
2026-06-09 20:00:08,585 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 8
2026-06-09 20:00:14,202 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-09 20:00:17,936 - IveltScraper - INFO - ivelt scrape complete. Checked 1 topics.
2026-06-09 20:00:17,936 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-09 20:00:18,858 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-09 20:00:24,428 - IveltScraper - INFO - yidtish scrape complete. Checked 2 topics.
2026-06-09 20:00:24,428 - IveltScraper - INFO - All forums scrape complete. Found 15 new posts.
2026-06-09 20:00:24,428 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-09 20:00:24,429 - __main__ - INFO - Scraper yiddish24 completed: 8 results
2026-06-09 20:00:24,429 - __main__ - INFO - Scraper ivelt completed: 15 results
2026-06-09 20:00:25,188 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-09 20:00:25.188327
2026-06-09 20:00:25,188 - __main__ - INFO - Email sent successfully
2026-06-09 20:00:25,188 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-09 20:00:25,189 - __main__ - INFO - Monitor complete. Found 26 total results: 3 new rss results, 8 new yiddish24 results, 15 new ivelt results.
2026-06-09 20:00:25,189 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-09 20:00:25,189 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 20:00:25,236 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-09 20:00:25,236 - __main__ - INFO - Closed all database connections
2026-06-09 20:00:25,238 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 20:00:25,239 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-09 20:30:01,926 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-09.log
2026-06-09 20:30:01,927 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-09.log
2026-06-09 20:30:01,927 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-09.log
2026-06-09 20:30:01,927 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-09 20:30:01,966 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-09 20:30:01,966 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-09 20:30:01,966 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-09 20:30:01,968 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-09 20:30:01,969 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-09 20:30:01,987 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-09 20:30:01,987 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-09 20:30:01,988 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-09 20:30:01,988 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-09 20:30:01,988 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-09 20:30:01,988 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-09 20:30:01,989 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-09 20:30:01,989 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-09 20:30:01,989 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-09 20:30:01,991 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-09 20:30:01,992 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-09 20:30:01,994 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-09 20:30:01,999 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-09 20:30:01,999 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=4
2026-06-09 20:30:02,001 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-09 20:30:02,001 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-09 20:30:02,001 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-09 20:30:02,001 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-09 20:30:02,001 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-09 20:30:02,001 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-09 20:30:02,881 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-09 20:30:02,914 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: My agent has opinions about other agents and human in one group now.
2026-06-09 20:30:02,924 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Help uploading docs
2026-06-09 20:30:02,933 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Using Claude as an orchestrator to run Ollama / Gemma as a local LLM;
2026-06-09 20:30:02,945 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I have 4x 128 GB VRAM now , what should i do.
2026-06-09 20:30:04,100 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-06-09 20:30:04,101 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-09 20:30:04,101 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-09 20:30:04,101 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-09 20:30:05,137 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-06-09 20:30:06,363 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-09 20:30:06,364 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-09 20:30:06,364 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-09 20:30:06,364 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-09 20:30:07,233 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-06-09 20:30:08,488 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-09 20:30:08,489 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-09 20:30:08,489 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-09 20:30:08,489 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-09 20:30:10,047 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: How do you usually setup your profiles and how many profiles do you ha
2026-06-09 20:30:10,086 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: my learnings after testing agent workflows
2026-06-09 20:30:11,334 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-09 20:30:12,944 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/RepHermesEX: (FS)(US) k25 Craie Togo /uphw Minion
2026-06-09 20:30:12,984 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/SubspacePhysics: The Lumenos Intelligence-Consciousness Ledger
2026-06-09 20:30:14,144 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-09 20:30:15,390 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: New to hermes. Spare computer, what to do with it.
2026-06-09 20:30:16,585 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-09 20:30:19,341 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-09 20:30:19,342 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-09 20:30:21,820 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-09 20:30:24,199 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-09 20:30:26,104 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-09 20:30:26,104 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-09 20:30:28,147 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 5
2026-06-09 20:30:28,148 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-09 20:30:28,269 - TwitterScraper - INFO - Using XAI (Grok) for real-time Twitter/X search
2026-06-09 20:30:28,274 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-09 20:30:28,870 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-09 20:30:30,132 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-09 20:30:30,574 - LinkedInScraper - INFO - New LinkedIn post: Gemma 4 + Hermes is INSANE (Free + Local!) - LinkedIn
2026-06-09 20:30:30,583 - LinkedInScraper - INFO - New LinkedIn post: Claude + Hermes Setup is WILD - LinkedIn
2026-06-09 20:30:30,749 - LinkedInScraper - INFO - New LinkedIn post: Every AI agent needs a brain โ and Gemma 4 is that brain, completely f
2026-06-09 20:30:31,466 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-09 20:30:31,623 - LinkedInScraper - INFO - New LinkedIn post: Iโm building plyrIQ with an AI development team, and hereโs what nobod
2026-06-09 20:30:31,895 - LinkedInScraper - INFO - New LinkedIn post: A real, production-grade, multi-agent workflow that looked like this f
2026-06-09 20:30:32,061 - LinkedInScraper - INFO - New LinkedIn post: Claude Code assumes things. Over-engineers everything. Touches code yo
2026-06-09 20:30:32,124 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 6 new results.
2026-06-09 20:30:32,124 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-09 20:30:35,941 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-09 20:30:35,966 - GitHubScraper - INFO - Found 236 GitHub repositories for term: paperclip
2026-06-09 20:30:36,246 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-09 20:30:36,248 - TwitterScraper - INFO - XAI Search: found 0 tweets for 'paperclip'
2026-06-09 20:30:37,128 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-09 20:30:37,132 - GitHubScraper - INFO - Found 340 GitHub repositories for term: "Hermes Agent"
2026-06-09 20:30:38,143 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-09 20:30:38,147 - GitHubScraper - INFO - Found 50 GitHub repositories for term: multica
2026-06-09 20:30:38,279 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-09 20:30:38,361 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-09 20:30:38,363 - TwitterScraper - INFO - XAI Search: found 0 tweets for '"Hermes Agent"'
2026-06-09 20:30:40,479 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-09 20:30:40,480 - TwitterScraper - INFO - XAI Search: found 0 tweets for 'multica'
2026-06-09 20:30:40,480 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-09 20:30:40,481 - __main__ - INFO - Scraper reddit completed: 9 results
2026-06-09 20:30:40,481 - __main__ - INFO - Scraper github completed: 0 results
2026-06-09 20:30:40,481 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-09 20:30:40,481 - __main__ - INFO - Scraper linkedin completed: 6 results
2026-06-09 20:30:40,481 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-09 20:30:41,164 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-09 20:30:41.164613
2026-06-09 20:30:41,165 - __main__ - INFO - Email sent successfully
2026-06-09 20:30:41,165 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-09 20:30:41,165 - __main__ - INFO - Monitor complete. Found 15 total results: 9 new reddit results, 6 new linkedin results.
2026-06-09 20:30:41,165 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-09 20:30:41,165 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 20:30:41,378 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-09 20:30:41,378 - __main__ - INFO - Closed all database connections
2026-06-09 20:30:41,380 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 20:30:41,380 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-09 21:00:01,905 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-09.log
2026-06-09 21:00:01,906 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-09.log
2026-06-09 21:00:01,906 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-09.log
2026-06-09 21:00:01,906 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-09 21:00:01,943 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-09 21:00:01,943 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-09 21:00:01,945 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-09 21:00:01,946 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-09 21:00:01,972 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-09 21:00:01,972 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-09 21:00:01,974 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-09 21:00:01,974 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-09 21:00:01,974 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-09 21:00:01,977 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-09 21:00:01,977 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-09 21:00:01,977 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-09 21:00:01,979 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-09 21:00:01,984 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-09 21:00:01,984 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=4
2026-06-09 21:00:01,986 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-09 21:00:01,986 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-09 21:00:01,986 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-09 21:00:01,986 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-09 21:00:01,986 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-09 21:00:01,986 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-09 21:00:02,071 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-09 21:00:02,076 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-09 21:00:02,076 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-09 21:00:02,077 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-09 21:00:02,767 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-09 21:00:03,333 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-06-09 21:00:07,607 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-09 21:00:07,821 - Yiddish24Scraper - INFO - Received response with 483920 characters
2026-06-09 21:00:07,824 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (307614 chars)
2026-06-09 21:00:07,827 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-09 21:00:07,911 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-09 21:00:07,949 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-09 21:00:07,949 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-09 21:00:08,639 - Yiddish24Scraper - INFO - Page 1 summary: 8 new out of 100 total articles
2026-06-09 21:00:08,639 - Yiddish24Scraper - INFO - Page 1: 8/100 new items
2026-06-09 21:00:08,639 - Yiddish24Scraper - INFO - Low new item ratio (8.0%), stopping pagination
2026-06-09 21:00:08,640 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 8
2026-06-09 21:00:13,727 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-09 21:00:41,650 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.
2026-06-09 21:00:41,650 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-09 21:00:42,512 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-09 21:00:45,116 - IveltScraper - INFO - yidtish scrape complete. Checked 2 topics.
2026-06-09 21:00:45,116 - IveltScraper - INFO - All forums scrape complete. Found 27 new posts.
2026-06-09 21:00:45,117 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-09 21:00:45,117 - __main__ - INFO - Scraper yiddish24 completed: 8 results
2026-06-09 21:00:45,117 - __main__ - INFO - Scraper ivelt completed: 27 results
2026-06-09 21:00:45,843 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-09 21:00:45.843931
2026-06-09 21:00:45,844 - __main__ - INFO - Email sent successfully
2026-06-09 21:00:45,844 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-09 21:00:45,844 - __main__ - INFO - Monitor complete. Found 39 total results: 4 new rss results, 8 new yiddish24 results, 27 new ivelt results.
2026-06-09 21:00:45,844 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-09 21:00:45,844 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 21:00:45,935 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-09 21:00:45,935 - __main__ - INFO - Closed all database connections
2026-06-09 21:00:45,938 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 21:00:45,939 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-09 22:00:02,268 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-09.log
2026-06-09 22:00:02,268 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-09.log
2026-06-09 22:00:02,268 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-09.log
2026-06-09 22:00:02,269 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-09 22:00:02,312 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-09 22:00:02,312 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-09 22:00:02,314 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-09 22:00:02,315 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-09 22:00:02,339 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-09 22:00:02,339 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-09 22:00:02,384 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-09 22:00:02,385 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-09 22:00:02,385 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-09 22:00:02,387 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-09 22:00:02,387 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-09 22:00:02,387 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-09 22:00:02,390 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-09 22:00:02,394 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-09 22:00:02,394 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=4
2026-06-09 22:00:02,397 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-09 22:00:02,397 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-09 22:00:02,397 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-09 22:00:02,397 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-09 22:00:02,397 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-09 22:00:02,397 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-09 22:00:02,480 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-09 22:00:02,484 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-09 22:00:02,484 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-09 22:00:02,485 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-09 22:00:02,842 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-09 22:00:03,339 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-09 22:00:09,957 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-09 22:00:10,190 - Yiddish24Scraper - INFO - Received response with 493529 characters
2026-06-09 22:00:10,192 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (310549 chars)
2026-06-09 22:00:10,193 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-09 22:00:10,301 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-09 22:00:10,355 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-09 22:00:10,355 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-09 22:00:11,112 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-06-09 22:00:11,112 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-06-09 22:00:11,112 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-06-09 22:00:11,113 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-06-09 22:00:14,189 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-09 22:01:00,201 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-06-09 22:01:00,201 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-09 22:01:01,011 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-09 22:01:02,337 - IveltScraper - INFO - yidtish scrape complete. Checked 1 topics.
2026-06-09 22:01:02,337 - IveltScraper - INFO - All forums scrape complete. Found 49 new posts.
2026-06-09 22:01:02,337 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-09 22:01:02,337 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-06-09 22:01:02,338 - __main__ - INFO - Scraper ivelt completed: 49 results
2026-06-09 22:01:03,099 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-09 22:01:03.099027
2026-06-09 22:01:03,099 - __main__ - INFO - Email sent successfully
2026-06-09 22:01:03,099 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-09 22:01:03,099 - __main__ - INFO - Monitor complete. Found 58 total results: 3 new rss results, 6 new yiddish24 results, 49 new ivelt results.
2026-06-09 22:01:03,099 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-09 22:01:03,099 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 22:01:03,434 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-09 22:01:03,434 - __main__ - INFO - Closed all database connections
2026-06-09 22:01:03,437 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 22:01:03,437 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-09 22:30:01,965 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-09.log
2026-06-09 22:30:01,965 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-09.log
2026-06-09 22:30:01,966 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-09.log
2026-06-09 22:30:01,966 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-09 22:30:02,003 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-09 22:30:02,003 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-09 22:30:02,003 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-09 22:30:02,006 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-09 22:30:02,006 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-09 22:30:02,022 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-09 22:30:02,022 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-09 22:30:02,023 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-09 22:30:02,023 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-09 22:30:02,023 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-09 22:30:02,023 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-09 22:30:02,024 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-09 22:30:02,024 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-09 22:30:02,024 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-09 22:30:02,026 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-09 22:30:02,026 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-09 22:30:02,029 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-09 22:30:02,033 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-09 22:30:02,033 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=4
2026-06-09 22:30:02,035 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-09 22:30:02,035 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-09 22:30:02,035 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-09 22:30:02,035 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-09 22:30:02,035 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-09 22:30:02,035 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-09 22:30:02,820 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-09 22:30:02,856 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Claude refusing to give up control
2026-06-09 22:30:04,068 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-06-09 22:30:04,068 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-09 22:30:04,068 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-09 22:30:04,068 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-09 22:30:05,026 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-06-09 22:30:05,059 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: AI Must Survive -- Paper Clip inspired Idle Game
2026-06-09 22:30:05,068 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Browser Games like Universal Paperclips
2026-06-09 22:30:06,246 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-06-09 22:30:06,247 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-09 22:30:06,247 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-09 22:30:06,247 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-09 22:30:07,120 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-06-09 22:30:08,480 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-09 22:30:08,481 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-09 22:30:08,481 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-09 22:30:08,481 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-09 22:30:10,587 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-09 22:30:11,524 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/unixporn: [Hyprland] local Hermes AI in the bar, live security score, everything
2026-06-09 22:30:11,533 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/u_ake13-art: [Arch | Hyprland] local Hermes AI in the bar, live security score, eve
2026-06-09 22:30:12,700 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-09 22:30:15,089 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-09 22:30:16,976 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-09 22:30:16,976 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-09 22:30:19,368 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-09 22:30:21,659 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-09 22:30:23,713 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-09 22:30:23,714 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-09 22:30:25,763 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 2
2026-06-09 22:30:25,763 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-09 22:30:25,862 - TwitterScraper - INFO - Using XAI (Grok) for real-time Twitter/X search
2026-06-09 22:30:25,867 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-09 22:30:26,423 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-09 22:30:27,645 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-09 22:30:29,057 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-09 22:30:29,793 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.
2026-06-09 22:30:29,793 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-09 22:30:36,419 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-09 22:30:36,445 - GitHubScraper - INFO - Found 236 GitHub repositories for term: paperclip
2026-06-09 22:30:37,052 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-09 22:30:37,054 - TwitterScraper - INFO - XAI Search: found 0 tweets for 'paperclip'
2026-06-09 22:30:37,565 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-09 22:30:37,654 - GitHubScraper - INFO - Found 340 GitHub repositories for term: "Hermes Agent"
2026-06-09 22:30:38,605 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-09 22:30:38,608 - GitHubScraper - INFO - Found 50 GitHub repositories for term: multica
2026-06-09 22:30:38,755 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-09 22:30:39,235 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-09 22:30:39,236 - TwitterScraper - INFO - XAI Search: found 0 tweets for '"Hermes Agent"'
2026-06-09 22:30:42,474 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-09 22:30:42,476 - TwitterScraper - INFO - XAI Search: found 0 tweets for 'multica'
2026-06-09 22:30:42,476 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-09 22:30:42,476 - __main__ - INFO - Scraper reddit completed: 5 results
2026-06-09 22:30:42,476 - __main__ - INFO - Scraper github completed: 0 results
2026-06-09 22:30:42,476 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-09 22:30:42,476 - __main__ - INFO - Scraper linkedin completed: 0 results
2026-06-09 22:30:42,476 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-09 22:30:43,088 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-09 22:30:43.088729
2026-06-09 22:30:43,089 - __main__ - INFO - Email sent successfully
2026-06-09 22:30:43,089 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-09 22:30:43,089 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new reddit results.
2026-06-09 22:30:43,089 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-09 22:30:43,089 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 22:30:43,286 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-09 22:30:43,286 - __main__ - INFO - Closed all database connections
2026-06-09 22:30:43,288 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 22:30:43,289 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-09 23:00:02,598 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-09.log
2026-06-09 23:00:02,598 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-09.log
2026-06-09 23:00:02,598 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-09.log
2026-06-09 23:00:02,599 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-09 23:00:02,662 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-09 23:00:02,662 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-09 23:00:02,664 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-09 23:00:02,665 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-09 23:00:02,687 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-09 23:00:02,688 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-09 23:00:02,757 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-09 23:00:02,758 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-09 23:00:02,758 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-09 23:00:02,764 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-09 23:00:02,764 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-09 23:00:02,764 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-09 23:00:02,769 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-09 23:00:02,777 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-09 23:00:02,777 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=4
2026-06-09 23:00:02,779 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-09 23:00:02,779 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-09 23:00:02,779 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-09 23:00:02,779 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-09 23:00:02,779 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-09 23:00:02,779 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-09 23:00:02,863 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-09 23:00:02,868 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-09 23:00:02,868 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-09 23:00:02,869 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-09 23:00:03,174 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-09 23:00:03,617 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-09 23:00:14,620 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-09 23:00:59,458 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-09 23:00:59,461 - Yiddish24Scraper - INFO - Received response with 492119 characters
2026-06-09 23:00:59,462 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (311178 chars)
2026-06-09 23:00:59,464 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-09 23:00:59,533 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-09 23:00:59,572 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-06-09 23:00:59,572 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-06-09 23:01:00,325 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 99 total articles
2026-06-09 23:01:00,325 - Yiddish24Scraper - INFO - Page 1: 6/99 new items
2026-06-09 23:01:00,326 - Yiddish24Scraper - INFO - Low new item ratio (6.1%), stopping pagination
2026-06-09 23:01:00,326 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-06-09 23:01:40,130 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-06-09 23:01:40,130 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-09 23:01:40,963 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-09 23:01:42,305 - IveltScraper - INFO - yidtish scrape complete. Checked 1 topics.
2026-06-09 23:01:42,305 - IveltScraper - INFO - All forums scrape complete. Found 76 new posts.
2026-06-09 23:01:42,306 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-09 23:01:42,306 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-06-09 23:01:42,306 - __main__ - INFO - Scraper ivelt completed: 76 results
2026-06-09 23:01:43,067 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-09 23:01:43.067822
2026-06-09 23:01:43,068 - __main__ - INFO - Email sent successfully
2026-06-09 23:01:43,068 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-09 23:01:43,068 - __main__ - INFO - Monitor complete. Found 85 total results: 3 new rss results, 6 new yiddish24 results, 76 new ivelt results.
2026-06-09 23:01:43,068 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-09 23:01:43,068 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 23:01:43,249 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-09 23:01:43,250 - __main__ - INFO - Closed all database connections
2026-06-09 23:01:43,252 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-09 23:01:43,252 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...