← Logs

social_media_monitor_2026-05-24.log

2026-05-24 19:00:12,929 - Yiddish24Scraper - INFO - Received response with 528130 characters

2026-05-24 19:00:12,933 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (320036 chars)

2026-05-24 19:00:12,939 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-24 19:00:13,032 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-24 19:00:13,072 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-24 19:00:13,072 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-24 19:00:13,150 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-24 19:00:13,150 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-24 19:00:13,862 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/Zachlich__260_260524013715.mp3

2026-05-24 19:00:15,308 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_Zachlich__260_260524013715.mp3 (19.1 MB)

2026-05-24 19:00:15,313 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-24 19:00:15,342 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_Zachlich__260_260524013715.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-24 19:00:16,293 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles

2026-05-24 19:00:16,294 - Yiddish24Scraper - INFO - Page 1: 6/100 new items

2026-05-24 19:00:16,294 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination

2026-05-24 19:00:16,294 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-05-24 19:00:16,301 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-24 19:01:19,249 - IveltScraper - INFO - Ivelt scrape complete. Checked 9 topics, found 45 new posts.

2026-05-24 19:01:19,250 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-24 19:01:19,250 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-05-24 19:01:19,250 - __main__ - INFO - Scraper ivelt completed: 45 results

2026-05-24 19:01:19,951 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-24 19:01:19.951530

2026-05-24 19:01:19,951 - __main__ - INFO - Email sent successfully

2026-05-24 19:01:19,953 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-24 19:01:19,953 - __main__ - INFO - Monitor complete. Found 54 total results: 3 new rss results, 6 new yiddish24 results, 45 new ivelt results.

2026-05-24 19:01:19,953 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-24 19:01:19,953 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 19:01:20,040 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-24 19:01:20,041 - __main__ - INFO - Closed all database connections

2026-05-24 19:01:20,043 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 19:01:20,043 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-24 20:00:02,287 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-24.log

2026-05-24 20:00:02,290 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-24.log

2026-05-24 20:00:02,290 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-24.log

2026-05-24 20:00:02,290 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-24 20:00:02,317 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-24 20:00:02,317 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-24 20:00:02,329 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-24 20:00:02,336 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-24 20:00:02,374 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-24 20:00:02,375 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-24 20:00:02,421 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-24 20:00:02,425 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-24 20:00:02,425 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-24 20:00:02,456 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-24 20:00:02,456 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-24 20:00:02,456 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-24 20:00:02,459 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-24 20:00:02,464 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-24 20:00:02,464 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-24 20:00:02,468 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-24 20:00:02,468 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-24 20:00:02,468 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-24 20:00:02,468 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-24 20:00:02,468 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-24 20:00:02,468 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-24 20:00:02,628 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-24 20:00:02,637 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-24 20:00:02,638 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-24 20:00:02,640 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-24 20:00:03,087 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-24 20:00:03,726 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-24 20:00:07,260 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-24 20:00:07,263 - Yiddish24Scraper - INFO - Received response with 524090 characters

2026-05-24 20:00:07,264 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (317171 chars)

2026-05-24 20:00:07,267 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-24 20:00:07,353 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-24 20:00:07,394 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-24 20:00:07,394 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-24 20:00:07,409 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-24 20:00:07,409 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-24 20:00:07,909 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/Git_Gefraigt_260_260524033736.mp3

2026-05-24 20:00:08,122 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_Git_Gefraigt_260_260524033736.mp3 (9.7 MB)

2026-05-24 20:00:08,129 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-24 20:00:08,140 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_Git_Gefraigt_260_260524033736.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-24 20:00:09,279 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles

2026-05-24 20:00:09,279 - Yiddish24Scraper - INFO - Page 1: 5/100 new items

2026-05-24 20:00:09,279 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination

2026-05-24 20:00:09,280 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5

2026-05-24 20:00:14,904 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-24 20:00:36,058 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 30 new posts.

2026-05-24 20:00:36,059 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-24 20:00:36,059 - __main__ - INFO - Scraper yiddish24 completed: 5 results

2026-05-24 20:00:36,059 - __main__ - INFO - Scraper ivelt completed: 30 results

2026-05-24 20:00:36,966 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-24 20:00:36.966684

2026-05-24 20:00:36,967 - __main__ - INFO - Email sent successfully

2026-05-24 20:00:36,967 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-24 20:00:36,967 - __main__ - INFO - Monitor complete. Found 38 total results: 3 new rss results, 5 new yiddish24 results, 30 new ivelt results.

2026-05-24 20:00:36,967 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-24 20:00:36,967 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 20:00:37,062 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-24 20:00:37,062 - __main__ - INFO - Closed all database connections

2026-05-24 20:00:37,064 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 20:00:37,064 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-24 20:30:02,945 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-24.log

2026-05-24 20:30:02,948 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-24.log

2026-05-24 20:30:02,948 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-24.log

2026-05-24 20:30:02,948 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-24 20:30:02,974 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-24 20:30:02,975 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-05-24 20:30:02,975 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-24 20:30:02,983 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-24 20:30:02,989 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-24 20:30:03,172 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-24 20:30:03,172 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-24 20:30:03,174 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-24 20:30:03,174 - __main__ - INFO - Reddit scraper initialized and enabled

2026-05-24 20:30:03,174 - __main__ - INFO - GitHub scraper initialized and enabled

2026-05-24 20:30:03,174 - __main__ - INFO - Twitter scraper initialized and enabled

2026-05-24 20:30:03,179 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-24 20:30:03,179 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-05-24 20:30:03,179 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-05-24 20:30:03,185 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-24 20:30:03,185 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-24 20:30:03,209 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-24 20:30:03,214 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-24 20:30:03,214 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-24 20:30:03,216 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-24 20:30:03,216 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-24 20:30:03,216 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-24 20:30:03,216 - __main__ - INFO - Running 5 scrapers concurrently...

2026-05-24 20:30:03,216 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-24 20:30:03,216 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-05-24 20:30:04,697 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-05-24 20:30:04,833 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent Operating System (2026): The Mission Control Stack

2026-05-24 20:30:04,846 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent OS 3.0 Just Dropped... 🤯

2026-05-24 20:30:04,866 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes took over OpenClaw's Telegram bot!

2026-05-24 20:30:04,880 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Any thoughts on Hermes Agent?

2026-05-24 20:30:04,896 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Tips for choosing a local agent?

2026-05-24 20:30:04,909 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How does your Hermes Agent connect to TikTok to scrap trending video a

2026-05-24 20:30:04,927 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent memory tip: Model Context Protocol without the stale cont

2026-05-24 20:30:04,946 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I made two Claude instances talk to each other autonomously

2026-05-24 20:30:06,126 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 8

2026-05-24 20:30:06,126 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-05-24 20:30:06,126 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-05-24 20:30:06,126 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-05-24 20:30:07,310 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-05-24 20:30:07,352 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Need Help!

2026-05-24 20:30:07,364 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Paperclip C6: powers.

2026-05-24 20:30:07,383 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Group of 104 German rocket scientists, some previously involved with t

2026-05-24 20:30:07,397 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Can I get free shipping on RC spare parts from online stores?

2026-05-24 20:30:07,408 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: What is this?

2026-05-24 20:30:08,567 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 5

2026-05-24 20:30:08,567 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-05-24 20:30:08,567 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-05-24 20:30:08,567 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-05-24 20:30:09,570 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-05-24 20:30:10,855 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-24 20:30:10,856 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-05-24 20:30:10,856 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-05-24 20:30:10,856 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-05-24 20:30:13,127 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/micro_saas: SAAS Built with AI Agent

2026-05-24 20:30:13,156 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Codex Goal Command Turns Codex Into A Goal-Based Agent

2026-05-24 20:30:13,196 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Antigravity CLI Turns Agent OS Into A Google AI Command Center

2026-05-24 20:30:13,238 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Hermes as Coding Agent and Log Viewer have sense?

2026-05-24 20:30:13,285 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Claude Code Free API Turns OpenRouter Models Into Builders

2026-05-24 20:30:14,393 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-05-24 20:30:16,941 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-05-24 20:30:18,413 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/oMLX: oMLX plus Gemma4 + DFlash draft model doom loop

2026-05-24 20:30:19,622 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-05-24 20:30:21,810 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-05-24 20:30:21,810 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-05-24 20:30:24,368 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-05-24 20:30:26,432 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-05-24 20:30:28,451 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-05-24 20:30:28,452 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-05-24 20:30:30,412 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 6

2026-05-24 20:30:30,413 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-24 20:30:30,619 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-24 20:30:31,094 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-05-24 20:30:44,852 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-05-24 20:30:56,868 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-05-24 20:31:10,795 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-05-24 20:31:10,796 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-24 20:31:11,425 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-05-24 20:31:12,960 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-05-24 20:31:14,646 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-05-24 20:31:15,367 - LinkedInScraper - INFO - New LinkedIn post: BerriAI's litellm-agent-platform gives you a self-hosted backend for C

2026-05-24 20:31:15,563 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 1 new results.

2026-05-24 20:31:15,563 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-05-24 20:31:22,231 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-24 20:31:22,256 - GitHubScraper - INFO - Found 231 GitHub repositories for term: paperclip

2026-05-24 20:31:23,484 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-24 20:31:23,488 - GitHubScraper - INFO - Found 278 GitHub repositories for term: "Hermes Agent"

2026-05-24 20:31:24,486 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-24 20:31:24,580 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica

2026-05-24 20:31:24,788 - GitHubScraper - INFO - Total GitHub results found: 0

2026-05-24 20:31:24,788 - __main__ - INFO - Scraper reddit completed: 19 results

2026-05-24 20:31:24,788 - __main__ - INFO - Scraper github completed: 0 results

2026-05-24 20:31:24,788 - __main__ - INFO - Scraper twitter completed: 0 results

2026-05-24 20:31:24,788 - __main__ - INFO - Scraper linkedin completed: 1 results

2026-05-24 20:31:24,788 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-05-24 20:31:26,449 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-24 20:31:26.449813

2026-05-24 20:31:26,450 - __main__ - INFO - Email sent successfully

2026-05-24 20:31:26,450 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-24 20:31:26,450 - __main__ - INFO - Monitor complete. Found 20 total results: 19 new reddit results, 1 new linkedin results.

2026-05-24 20:31:26,450 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-24 20:31:26,450 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 20:31:26,664 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-24 20:31:26,664 - __main__ - INFO - Closed all database connections

2026-05-24 20:31:26,712 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 20:31:26,725 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-24 21:00:01,815 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-24.log

2026-05-24 21:00:01,816 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-24.log

2026-05-24 21:00:01,817 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-24.log

2026-05-24 21:00:01,817 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-24 21:00:01,841 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-24 21:00:01,841 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-24 21:00:01,843 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-24 21:00:01,844 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-24 21:00:02,311 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-24 21:00:02,311 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-24 21:00:02,313 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-24 21:00:02,315 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-24 21:00:02,315 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-24 21:00:02,321 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-24 21:00:02,321 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-24 21:00:02,321 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-24 21:00:02,350 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-24 21:00:02,359 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-24 21:00:02,359 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-24 21:00:02,361 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-24 21:00:02,361 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-24 21:00:02,361 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-24 21:00:02,361 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-24 21:00:02,362 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-24 21:00:02,362 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-24 21:00:02,445 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-24 21:00:02,465 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-24 21:00:02,465 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-24 21:00:02,466 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-24 21:00:02,857 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-24 21:00:03,260 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-24 21:00:06,681 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-24 21:00:06,896 - Yiddish24Scraper - INFO - Received response with 544010 characters

2026-05-24 21:00:06,900 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (324826 chars)

2026-05-24 21:00:06,905 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-24 21:00:06,989 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-24 21:00:07,027 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-24 21:00:07,028 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-24 21:00:07,100 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-24 21:00:07,100 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-24 21:00:07,810 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/LAZER_1_260_260524042103.mp3

2026-05-24 21:00:08,486 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_LAZER_1_260_260524042103.mp3 (89.5 MB)

2026-05-24 21:00:08,492 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-24 21:00:08,525 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_LAZER_1_260_260524042103.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-24 21:00:08,537 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-24 21:00:08,537 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-24 21:00:09,037 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/05_Treasures_Found__260_260524041908.mp3

2026-05-24 21:00:09,285 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_05_Treasures_Found__260_260524041908.mp3 (18.7 MB)

2026-05-24 21:00:09,286 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-24 21:00:09,294 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_05_Treasures_Found__260_260524041908.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-24 21:00:10,112 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 100 total articles

2026-05-24 21:00:10,112 - Yiddish24Scraper - INFO - Page 1: 10/100 new items

2026-05-24 21:00:10,112 - Yiddish24Scraper - INFO - Low new item ratio (10.0%), stopping pagination

2026-05-24 21:00:10,113 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10

2026-05-24 21:00:14,959 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-24 21:00:35,354 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 17 new posts.

2026-05-24 21:00:35,355 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-24 21:00:35,355 - __main__ - INFO - Scraper yiddish24 completed: 10 results

2026-05-24 21:00:35,355 - __main__ - INFO - Scraper ivelt completed: 17 results

2026-05-24 21:00:38,105 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-24 21:00:38.105814

2026-05-24 21:00:38,106 - __main__ - INFO - Email sent successfully

2026-05-24 21:00:38,106 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-24 21:00:38,106 - __main__ - INFO - Monitor complete. Found 30 total results: 3 new rss results, 10 new yiddish24 results, 17 new ivelt results.

2026-05-24 21:00:38,106 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-24 21:00:38,106 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 21:00:38,201 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-24 21:00:38,201 - __main__ - INFO - Closed all database connections

2026-05-24 21:00:38,203 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 21:00:38,203 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-24 22:00:02,729 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-24.log

2026-05-24 22:00:02,729 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-24.log

2026-05-24 22:00:02,730 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-24.log

2026-05-24 22:00:02,730 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-24 22:00:02,753 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-24 22:00:02,753 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-24 22:00:02,755 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-24 22:00:02,760 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-24 22:00:03,023 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-24 22:00:03,023 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-24 22:00:03,087 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-24 22:00:03,089 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-24 22:00:03,089 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-24 22:00:03,118 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-24 22:00:03,118 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-24 22:00:03,118 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-24 22:00:03,123 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-24 22:00:03,128 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-24 22:00:03,128 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-24 22:00:03,130 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-24 22:00:03,130 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-24 22:00:03,130 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-24 22:00:03,130 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-24 22:00:03,130 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-24 22:00:03,130 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-24 22:00:03,276 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-24 22:00:03,281 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-24 22:00:03,281 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-24 22:00:03,282 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-24 22:00:03,708 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-24 22:00:04,173 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-24 22:00:08,018 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-24 22:00:08,260 - Yiddish24Scraper - INFO - Received response with 536895 characters

2026-05-24 22:00:08,264 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (322370 chars)

2026-05-24 22:00:08,267 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-24 22:00:08,369 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-24 22:00:08,416 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-24 22:00:08,416 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-24 22:00:08,428 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-24 22:00:08,428 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-24 22:00:09,140 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________________________________476397127.mp3

2026-05-24 22:00:10,444 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________________________________476397127.mp3 (17.2 MB)

2026-05-24 22:00:10,444 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-24 22:00:10,455 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________________________________476397127.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-24 22:00:10,485 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-24 22:00:10,485 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-24 22:00:10,985 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/FARSHIDENS_antiqe_260_260524052629.mp3

2026-05-24 22:00:11,450 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_FARSHIDENS_antiqe_260_260524052629.mp3 (29.2 MB)

2026-05-24 22:00:11,451 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-24 22:00:11,462 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_FARSHIDENS_antiqe_260_260524052629.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-24 22:00:12,256 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles

2026-05-24 22:00:12,256 - Yiddish24Scraper - INFO - Page 1: 3/100 new items

2026-05-24 22:00:12,256 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination

2026-05-24 22:00:12,257 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3

2026-05-24 22:00:15,759 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-24 22:00:28,915 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 15 new posts.

2026-05-24 22:00:28,915 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-24 22:00:28,916 - __main__ - INFO - Scraper yiddish24 completed: 3 results

2026-05-24 22:00:28,916 - __main__ - INFO - Scraper ivelt completed: 15 results

2026-05-24 22:00:29,833 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-24 22:00:29.833306

2026-05-24 22:00:29,833 - __main__ - INFO - Email sent successfully

2026-05-24 22:00:29,833 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-24 22:00:29,834 - __main__ - INFO - Monitor complete. Found 21 total results: 3 new rss results, 3 new yiddish24 results, 15 new ivelt results.

2026-05-24 22:00:29,834 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-24 22:00:29,834 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 22:00:29,966 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-24 22:00:29,966 - __main__ - INFO - Closed all database connections

2026-05-24 22:00:29,968 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 22:00:29,968 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-24 22:30:01,904 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-24.log

2026-05-24 22:30:01,907 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-24.log

2026-05-24 22:30:01,907 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-24.log

2026-05-24 22:30:01,907 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-24 22:30:01,951 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-24 22:30:01,951 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-05-24 22:30:01,951 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-24 22:30:01,953 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-24 22:30:01,953 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-24 22:30:02,154 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-24 22:30:02,154 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-24 22:30:02,155 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-24 22:30:02,155 - __main__ - INFO - Reddit scraper initialized and enabled

2026-05-24 22:30:02,155 - __main__ - INFO - GitHub scraper initialized and enabled

2026-05-24 22:30:02,156 - __main__ - INFO - Twitter scraper initialized and enabled

2026-05-24 22:30:02,159 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-24 22:30:02,159 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-05-24 22:30:02,159 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-05-24 22:30:02,161 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-24 22:30:02,161 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-24 22:30:02,187 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-24 22:30:02,191 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-24 22:30:02,191 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-24 22:30:02,193 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-24 22:30:02,193 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-24 22:30:02,193 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-24 22:30:02,193 - __main__ - INFO - Running 5 scrapers concurrently...

2026-05-24 22:30:02,193 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-24 22:30:02,193 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-05-24 22:30:03,149 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-05-24 22:30:03,193 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent model routing guide: Model Context Protocol without the s

2026-05-24 22:30:03,213 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Any interest in a floating, voice-capable macOS companion for Hermes A

2026-05-24 22:30:03,236 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Suggestions required for the best mini pc or mac mini to run OpenClaw

2026-05-24 22:30:03,263 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent Browser (2026): AI Agents Can Finally Browse

2026-05-24 22:30:04,444 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4

2026-05-24 22:30:04,444 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-05-24 22:30:04,444 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-05-24 22:30:04,444 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-05-24 22:30:05,253 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-05-24 22:30:05,295 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: infinite toilet paper hack

2026-05-24 22:30:06,460 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1

2026-05-24 22:30:06,460 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-05-24 22:30:06,460 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-05-24 22:30:06,460 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-05-24 22:30:07,338 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-05-24 22:30:08,583 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-24 22:30:08,583 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-05-24 22:30:08,583 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-05-24 22:30:08,583 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-05-24 22:30:09,584 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: WORKSHOP: Teach Hermes to Drive Any Website — Zero Config

2026-05-24 22:30:09,619 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/u_No_Policy7548: I set up an Al agent on my Mac mini that researches, builds, and sells

2026-05-24 22:30:09,628 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MercuryInstall: Mercury Agent install note: Mercury open-source agent without the setu

2026-05-24 22:30:09,651 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Hermes AI Agent With Agentic OS Is A Wild SEO Shortcut

2026-05-24 22:30:09,690 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ClaudeWorkflows: [Workflow] Autonomous Claude-to-Claude Communication via Playwright an

2026-05-24 22:30:09,699 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AI_Agents: OpenClaw + Hermes users: how many agents are you actually running day

2026-05-24 22:30:10,807 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-05-24 22:30:12,064 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/u_No_Policy7548: Ai Automation (3yrs) + ML + LLM/prompting + OpenClaw/Hermes tutor. Pre

2026-05-24 22:30:12,083 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AI_Agents: I built an AI that owns its own directory, creates files without being

2026-05-24 22:30:13,147 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-05-24 22:30:15,386 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-05-24 22:30:17,386 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-05-24 22:30:17,386 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-05-24 22:30:19,731 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-05-24 22:30:21,689 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-05-24 22:30:23,662 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-05-24 22:30:23,662 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-05-24 22:30:25,573 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 8

2026-05-24 22:30:25,573 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-24 22:30:25,701 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-24 22:30:26,141 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-05-24 22:30:40,119 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-05-24 22:30:54,087 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-05-24 22:31:06,257 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-05-24 22:31:06,258 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-24 22:31:06,814 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-05-24 22:31:08,123 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-05-24 22:31:08,195 - LinkedInScraper - INFO - New LinkedIn post: Claude Code / Codex / Hermes agent log #9: how I'm using my agents thi

2026-05-24 22:31:08,511 - LinkedInScraper - INFO - New LinkedIn post: Setting Up Hermes Agent: Architecture, Tooling & Real-World Experience

2026-05-24 22:31:09,487 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-05-24 22:31:10,299 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.

2026-05-24 22:31:10,300 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-05-24 22:31:15,086 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-24 22:31:15,181 - GitHubScraper - INFO - Found 231 GitHub repositories for term: paperclip

2026-05-24 22:31:16,409 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-24 22:31:16,503 - GitHubScraper - INFO - Found 278 GitHub repositories for term: "Hermes Agent"

2026-05-24 22:31:17,484 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-24 22:31:17,485 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica

2026-05-24 22:31:17,650 - GitHubScraper - INFO - Total GitHub results found: 0

2026-05-24 22:31:17,650 - __main__ - INFO - Scraper reddit completed: 13 results

2026-05-24 22:31:17,650 - __main__ - INFO - Scraper github completed: 0 results

2026-05-24 22:31:17,650 - __main__ - INFO - Scraper twitter completed: 0 results

2026-05-24 22:31:17,650 - __main__ - INFO - Scraper linkedin completed: 2 results

2026-05-24 22:31:17,651 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-05-24 22:31:18,370 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-24 22:31:18.370470

2026-05-24 22:31:18,370 - __main__ - INFO - Email sent successfully

2026-05-24 22:31:18,371 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-24 22:31:18,371 - __main__ - INFO - Monitor complete. Found 15 total results: 13 new reddit results, 2 new linkedin results.

2026-05-24 22:31:18,371 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-24 22:31:18,371 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 22:31:18,480 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-24 22:31:18,480 - __main__ - INFO - Closed all database connections

2026-05-24 22:31:18,517 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 22:31:18,533 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-24 23:00:01,694 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-24.log

2026-05-24 23:00:01,694 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-24.log

2026-05-24 23:00:01,694 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-24.log

2026-05-24 23:00:01,695 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-24 23:00:01,719 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-24 23:00:01,719 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-24 23:00:01,721 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-24 23:00:01,722 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-24 23:00:01,950 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-24 23:00:01,950 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-24 23:00:01,952 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-24 23:00:01,954 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-24 23:00:01,954 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-24 23:00:01,960 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-24 23:00:01,960 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-24 23:00:01,960 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-24 23:00:01,989 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-24 23:00:02,001 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-24 23:00:02,001 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-24 23:00:02,005 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-24 23:00:02,005 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-24 23:00:02,005 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-24 23:00:02,006 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-24 23:00:02,006 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-24 23:00:02,006 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-24 23:00:02,089 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-24 23:00:02,093 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-24 23:00:02,093 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-24 23:00:02,095 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-24 23:00:02,429 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-24 23:00:02,880 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-24 23:00:06,593 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-24 23:00:06,832 - Yiddish24Scraper - INFO - Received response with 547823 characters

2026-05-24 23:00:06,835 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (327809 chars)

2026-05-24 23:00:06,838 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-24 23:00:06,930 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-24 23:00:06,970 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-24 23:00:06,970 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-24 23:00:07,933 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 100 total articles

2026-05-24 23:00:07,933 - Yiddish24Scraper - INFO - Page 1: 4/100 new items

2026-05-24 23:00:07,933 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination

2026-05-24 23:00:07,934 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4

2026-05-24 23:00:13,872 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-24 23:00:20,491 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 8 new posts.

2026-05-24 23:00:20,492 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-24 23:00:20,492 - __main__ - INFO - Scraper yiddish24 completed: 4 results

2026-05-24 23:00:20,492 - __main__ - INFO - Scraper ivelt completed: 8 results

2026-05-24 23:00:21,206 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-24 23:00:21.206395

2026-05-24 23:00:21,206 - __main__ - INFO - Email sent successfully

2026-05-24 23:00:21,207 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-24 23:00:21,207 - __main__ - INFO - Monitor complete. Found 15 total results: 3 new rss results, 4 new yiddish24 results, 8 new ivelt results.

2026-05-24 23:00:21,207 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-24 23:00:21,207 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 23:00:21,248 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-24 23:00:21,248 - __main__ - INFO - Closed all database connections

2026-05-24 23:00:21,250 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-24 23:00:21,250 - social_media_monitor.database.connection - INFO - Closed 0 database connections