← Logs

social_media_monitor_2026-05-27.log

2026-05-27 19:00:11,726 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-27 19:00:11,770 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-27 19:00:11,770 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-27 19:00:11,809 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-27 19:00:11,809 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-27 19:00:12,311 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________________________________447438391.mp3

2026-05-27 19:00:13,304 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________________________________447438391.mp3 (1.8 MB)

2026-05-27 19:00:13,305 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-27 19:00:13,318 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________________________________447438391.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-27 19:00:13,561 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-27 19:00:13,562 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-27 19:00:14,062 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________________________________920455885.mp3

2026-05-27 19:00:15,528 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________________________________920455885.mp3 (19.8 MB)

2026-05-27 19:00:15,529 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-27 19:00:15,546 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________________________________920455885.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-27 19:00:16,226 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles

2026-05-27 19:00:16,226 - Yiddish24Scraper - INFO - Page 1: 5/100 new items

2026-05-27 19:00:16,226 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination

2026-05-27 19:00:16,226 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5

2026-05-27 19:00:16,234 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-27 19:00:49,588 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 27 new posts.

2026-05-27 19:00:49,588 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-27 19:00:49,588 - __main__ - INFO - Scraper yiddish24 completed: 5 results

2026-05-27 19:00:49,588 - __main__ - INFO - Scraper ivelt completed: 27 results

2026-05-27 19:00:50,298 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-27 19:00:50.298046

2026-05-27 19:00:50,298 - __main__ - INFO - Email sent successfully

2026-05-27 19:00:50,298 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-27 19:00:50,298 - __main__ - INFO - Monitor complete. Found 35 total results: 3 new rss results, 5 new yiddish24 results, 27 new ivelt results.

2026-05-27 19:00:50,298 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-27 19:00:50,298 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 19:00:50,372 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-27 19:00:50,372 - __main__ - INFO - Closed all database connections

2026-05-27 19:00:50,373 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 19:00:50,373 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-27 20:00:02,456 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-27.log

2026-05-27 20:00:02,456 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-27.log

2026-05-27 20:00:02,456 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-27.log

2026-05-27 20:00:02,456 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-27 20:00:02,482 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-27 20:00:02,482 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-27 20:00:02,484 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-27 20:00:02,485 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-27 20:00:02,547 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-27 20:00:02,548 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-27 20:00:02,598 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-27 20:00:02,599 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-27 20:00:02,599 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-27 20:00:02,614 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-27 20:00:02,614 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-27 20:00:02,614 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-27 20:00:02,617 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-27 20:00:02,621 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-27 20:00:02,621 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-27 20:00:02,624 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-27 20:00:02,624 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-27 20:00:02,624 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-27 20:00:02,624 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-27 20:00:02,624 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-27 20:00:02,624 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-27 20:00:02,723 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-27 20:00:02,729 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-27 20:00:02,729 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-27 20:00:02,731 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-27 20:00:03,098 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-27 20:00:03,508 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-27 20:00:06,958 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-27 20:00:07,136 - Yiddish24Scraper - INFO - Received response with 494327 characters

2026-05-27 20:00:07,137 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (317112 chars)

2026-05-27 20:00:07,140 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-27 20:00:07,243 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-27 20:00:07,286 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-27 20:00:07,286 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-27 20:00:07,309 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-27 20:00:07,309 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-27 20:00:07,809 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/GITS_260_260527022524.mp3

2026-05-27 20:00:07,842 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_GITS_260_260527022524.mp3 (177.6 KB)

2026-05-27 20:00:07,843 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-27 20:00:07,850 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_GITS_260_260527022524.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-27 20:00:08,606 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles

2026-05-27 20:00:08,607 - Yiddish24Scraper - INFO - Page 1: 5/100 new items

2026-05-27 20:00:08,607 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination

2026-05-27 20:00:08,607 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5

2026-05-27 20:00:14,346 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-27 20:00:28,871 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 10 new posts.

2026-05-27 20:00:28,871 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-27 20:00:28,872 - __main__ - INFO - Scraper yiddish24 completed: 5 results

2026-05-27 20:00:28,872 - __main__ - INFO - Scraper ivelt completed: 10 results

2026-05-27 20:00:29,627 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-27 20:00:29.627313

2026-05-27 20:00:29,627 - __main__ - INFO - Email sent successfully

2026-05-27 20:00:29,628 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-27 20:00:29,628 - __main__ - INFO - Monitor complete. Found 18 total results: 3 new rss results, 5 new yiddish24 results, 10 new ivelt results.

2026-05-27 20:00:29,628 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-27 20:00:29,628 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 20:00:29,730 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-27 20:00:29,731 - __main__ - INFO - Closed all database connections

2026-05-27 20:00:29,732 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 20:00:29,732 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-27 20:30:02,387 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-27.log

2026-05-27 20:30:02,387 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-27.log

2026-05-27 20:30:02,387 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-27.log

2026-05-27 20:30:02,387 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-27 20:30:02,411 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-27 20:30:02,411 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-05-27 20:30:02,411 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-27 20:30:02,413 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-27 20:30:02,414 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-27 20:30:02,547 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-27 20:30:02,547 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-27 20:30:02,548 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-27 20:30:02,548 - __main__ - INFO - Reddit scraper initialized and enabled

2026-05-27 20:30:02,548 - __main__ - INFO - GitHub scraper initialized and enabled

2026-05-27 20:30:02,548 - __main__ - INFO - Twitter scraper initialized and enabled

2026-05-27 20:30:02,549 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-27 20:30:02,549 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-05-27 20:30:02,550 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-05-27 20:30:02,553 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-27 20:30:02,553 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-27 20:30:02,571 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-27 20:30:02,576 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-27 20:30:02,576 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-27 20:30:02,579 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-27 20:30:02,579 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-27 20:30:02,580 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-27 20:30:02,580 - __main__ - INFO - Running 5 scrapers concurrently...

2026-05-27 20:30:02,580 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-27 20:30:02,580 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-05-27 20:30:03,435 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-05-27 20:30:03,495 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Has anyone here tried using Hermes Agent as a daily AI assistant?

2026-05-27 20:30:03,506 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Has anyone here tried using Hermes Agent as a daily AI assistant?

2026-05-27 20:30:03,520 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent Operating System is INSANE 🤯

2026-05-27 20:30:03,530 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Building a planning surface tool for coding agents so I can vibecode b

2026-05-27 20:30:03,539 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I'm loving my hermes agent but hating the UX

2026-05-27 20:30:03,554 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Got Hermes monitoring X with my own cookies, how would you do the same

2026-05-27 20:30:03,569 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent memory tip: Approval queue without the stale context trap

2026-05-27 20:30:03,584 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Built an open-source MCP server with 105 tools for WordPress page buil

2026-05-27 20:30:04,688 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 8

2026-05-27 20:30:04,688 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-05-27 20:30:04,688 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-05-27 20:30:04,688 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-05-27 20:30:05,745 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-05-27 20:30:05,790 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: AI Agent Operating System Builds 24/7 Agents While You Sleep

2026-05-27 20:30:06,930 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1

2026-05-27 20:30:06,930 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-05-27 20:30:06,930 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-05-27 20:30:06,930 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-05-27 20:30:08,289 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-05-27 20:30:09,487 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-27 20:30:09,488 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-05-27 20:30:09,488 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-05-27 20:30:09,488 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-05-27 20:30:10,478 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: How To Rank In Every AI Search Engine With Hermes

2026-05-27 20:30:10,498 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: NotebookLM Free Builds Videos, Podcasts, And Slide Decks

2026-05-27 20:30:10,515 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: FREE Antigravity CLI Install That Runs Multiple Agents

2026-05-27 20:30:10,524 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/warpdotdev: Warp/WarpPreview can now launch Agent Sessions Resume workflows

2026-05-27 20:30:10,564 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/OpenAI: Which provider fits best for my needs?

2026-05-27 20:30:11,611 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-05-27 20:30:13,608 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-05-27 20:30:15,748 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-05-27 20:30:17,677 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-05-27 20:30:17,677 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-05-27 20:30:20,217 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-05-27 20:30:22,143 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-05-27 20:30:24,212 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-05-27 20:30:24,212 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-05-27 20:30:26,436 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 5

2026-05-27 20:30:26,436 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-27 20:30:26,563 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-27 20:30:26,963 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-05-27 20:30:41,662 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-05-27 20:30:56,265 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-05-27 20:31:08,273 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-05-27 20:31:08,273 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-27 20:31:08,790 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-05-27 20:31:09,922 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-05-27 20:31:11,309 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-05-27 20:31:12,059 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.

2026-05-27 20:31:12,059 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-05-27 20:31:17,879 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-27 20:31:17,970 - GitHubScraper - INFO - Found 233 GitHub repositories for term: paperclip

2026-05-27 20:31:19,328 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-27 20:31:19,419 - GitHubScraper - INFO - Found 291 GitHub repositories for term: "Hermes Agent"

2026-05-27 20:31:20,529 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-27 20:31:20,532 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica

2026-05-27 20:31:20,665 - GitHubScraper - INFO - Total GitHub results found: 0

2026-05-27 20:31:20,665 - __main__ - INFO - Scraper reddit completed: 14 results

2026-05-27 20:31:20,665 - __main__ - INFO - Scraper github completed: 0 results

2026-05-27 20:31:20,665 - __main__ - INFO - Scraper twitter completed: 0 results

2026-05-27 20:31:20,665 - __main__ - INFO - Scraper linkedin completed: 0 results

2026-05-27 20:31:20,665 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-05-27 20:31:21,623 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-27 20:31:21.623229

2026-05-27 20:31:21,623 - __main__ - INFO - Email sent successfully

2026-05-27 20:31:21,623 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-27 20:31:21,623 - __main__ - INFO - Monitor complete. Found 14 total results: 14 new reddit results.

2026-05-27 20:31:21,623 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-27 20:31:21,623 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 20:31:21,712 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-27 20:31:21,713 - __main__ - INFO - Closed all database connections

2026-05-27 20:31:21,736 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 20:31:21,748 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-27 21:00:01,779 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-27.log

2026-05-27 21:00:01,779 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-27.log

2026-05-27 21:00:01,779 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-27.log

2026-05-27 21:00:01,779 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-27 21:00:01,813 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-27 21:00:01,813 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-27 21:00:01,816 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-27 21:00:01,816 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-27 21:00:01,894 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-27 21:00:01,894 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-27 21:00:01,895 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-27 21:00:01,896 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-27 21:00:01,896 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-27 21:00:01,899 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-27 21:00:01,899 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-27 21:00:01,899 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-27 21:00:01,916 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-27 21:00:01,920 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-27 21:00:01,922 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-27 21:00:01,924 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-27 21:00:01,924 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-27 21:00:01,924 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-27 21:00:01,924 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-27 21:00:01,924 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-27 21:00:01,924 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-27 21:00:02,011 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-27 21:00:02,016 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-27 21:00:02,016 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-27 21:00:02,018 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-27 21:00:02,425 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-27 21:00:02,842 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-27 21:00:06,370 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-27 21:00:06,554 - Yiddish24Scraper - INFO - Received response with 487719 characters

2026-05-27 21:00:06,555 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (315126 chars)

2026-05-27 21:00:06,557 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-27 21:00:06,665 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-27 21:00:06,716 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-27 21:00:06,716 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-27 21:00:06,726 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-27 21:00:06,727 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-27 21:00:07,422 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/POPLONOSH_260_260527022608.mp3

2026-05-27 21:00:08,946 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_POPLONOSH_260_260527022608.mp3 (20.6 MB)

2026-05-27 21:00:08,946 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-27 21:00:08,956 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_POPLONOSH_260_260527022608.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-27 21:00:09,602 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles

2026-05-27 21:00:09,602 - Yiddish24Scraper - INFO - Page 1: 3/100 new items

2026-05-27 21:00:09,602 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination

2026-05-27 21:00:09,602 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3

2026-05-27 21:00:13,382 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-27 21:00:28,634 - IveltScraper - INFO - Ivelt scrape complete. Checked 1 topics, found 20 new posts.

2026-05-27 21:00:28,634 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-27 21:00:28,634 - __main__ - INFO - Scraper yiddish24 completed: 3 results

2026-05-27 21:00:28,634 - __main__ - INFO - Scraper ivelt completed: 20 results

2026-05-27 21:00:29,519 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-27 21:00:29.519766

2026-05-27 21:00:29,519 - __main__ - INFO - Email sent successfully

2026-05-27 21:00:29,520 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-27 21:00:29,520 - __main__ - INFO - Monitor complete. Found 26 total results: 3 new rss results, 3 new yiddish24 results, 20 new ivelt results.

2026-05-27 21:00:29,520 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-27 21:00:29,520 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 21:00:29,576 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-27 21:00:29,576 - __main__ - INFO - Closed all database connections

2026-05-27 21:00:29,578 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 21:00:29,578 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-27 22:00:01,815 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-27.log

2026-05-27 22:00:01,815 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-27.log

2026-05-27 22:00:01,815 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-27.log

2026-05-27 22:00:01,816 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-27 22:00:01,839 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-27 22:00:01,839 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-27 22:00:01,842 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-27 22:00:01,842 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-27 22:00:01,966 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-27 22:00:01,966 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-27 22:00:02,011 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-27 22:00:02,012 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-27 22:00:02,012 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-27 22:00:02,040 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-27 22:00:02,040 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-27 22:00:02,040 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-27 22:00:02,044 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-27 22:00:02,050 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-27 22:00:02,051 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-27 22:00:02,053 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-27 22:00:02,053 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-27 22:00:02,053 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-27 22:00:02,053 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-27 22:00:02,053 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-27 22:00:02,053 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-27 22:00:02,156 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-27 22:00:02,160 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-27 22:00:02,160 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-27 22:00:02,163 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-27 22:00:02,493 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-27 22:00:02,933 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-27 22:00:06,174 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-27 22:00:06,353 - Yiddish24Scraper - INFO - Received response with 501826 characters

2026-05-27 22:00:06,356 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (320173 chars)

2026-05-27 22:00:06,358 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-27 22:00:06,438 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-27 22:00:06,477 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-27 22:00:06,477 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-27 22:00:06,495 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-27 22:00:06,495 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-27 22:00:06,995 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/OLD_LAZER_260_260527023316.mp3

2026-05-27 22:00:08,289 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_OLD_LAZER_260_260527023316.mp3 (15.9 MB)

2026-05-27 22:00:08,289 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-27 22:00:08,299 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_OLD_LAZER_260_260527023316.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-27 22:00:09,018 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles

2026-05-27 22:00:09,019 - Yiddish24Scraper - INFO - Page 1: 6/100 new items

2026-05-27 22:00:09,019 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination

2026-05-27 22:00:09,019 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-05-27 22:00:13,867 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-27 22:00:20,318 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 11 new posts.

2026-05-27 22:00:20,318 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-27 22:00:20,318 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-05-27 22:00:20,318 - __main__ - INFO - Scraper ivelt completed: 11 results

2026-05-27 22:00:21,067 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-27 22:00:21.067036

2026-05-27 22:00:21,067 - __main__ - INFO - Email sent successfully

2026-05-27 22:00:21,067 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-27 22:00:21,067 - __main__ - INFO - Monitor complete. Found 20 total results: 3 new rss results, 6 new yiddish24 results, 11 new ivelt results.

2026-05-27 22:00:21,067 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-27 22:00:21,067 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 22:00:21,156 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-27 22:00:21,156 - __main__ - INFO - Closed all database connections

2026-05-27 22:00:21,157 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 22:00:21,157 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-27 22:30:02,183 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-27.log

2026-05-27 22:30:02,183 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-27.log

2026-05-27 22:30:02,183 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-27.log

2026-05-27 22:30:02,183 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-27 22:30:02,207 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-27 22:30:02,207 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-05-27 22:30:02,207 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-27 22:30:02,210 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-27 22:30:02,215 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-27 22:30:02,256 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-27 22:30:02,256 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-27 22:30:02,260 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-27 22:30:02,260 - __main__ - INFO - Reddit scraper initialized and enabled

2026-05-27 22:30:02,260 - __main__ - INFO - GitHub scraper initialized and enabled

2026-05-27 22:30:02,260 - __main__ - INFO - Twitter scraper initialized and enabled

2026-05-27 22:30:02,262 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-27 22:30:02,262 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-05-27 22:30:02,262 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-05-27 22:30:02,268 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-27 22:30:02,268 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-27 22:30:02,293 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-27 22:30:02,302 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-27 22:30:02,302 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-27 22:30:02,306 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-27 22:30:02,306 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-27 22:30:02,307 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-27 22:30:02,307 - __main__ - INFO - Running 5 scrapers concurrently...

2026-05-27 22:30:02,307 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-27 22:30:02,307 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-05-27 22:30:03,315 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-05-27 22:30:03,361 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent model routing guide: Approval queue without the strongest

2026-05-27 22:30:03,380 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Mercury Agent install note: Mercury provider fallback without the setu

2026-05-27 22:30:04,580 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2

2026-05-27 22:30:04,580 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-05-27 22:30:04,580 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-05-27 22:30:04,580 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-05-27 22:30:05,812 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-05-27 22:30:05,855 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Decal and Foil Organization

2026-05-27 22:30:05,867 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: EXPERIMENT: hiring agents to do work in my startup

2026-05-27 22:30:05,881 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How do I pick a handcuff lock if I lose the key (for escape practice)?

2026-05-27 22:30:07,088 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 3

2026-05-27 22:30:07,089 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-05-27 22:30:07,089 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-05-27 22:30:07,089 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-05-27 22:30:08,319 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-05-27 22:30:09,598 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-27 22:30:09,598 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-05-27 22:30:09,599 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-05-27 22:30:09,599 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-05-27 22:30:10,843 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/Hyperagent: My HyperAgent use... lots of good, some bad and some real needs

2026-05-27 22:30:10,861 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/YAPms: Actual California Gubernatorial Ballot

2026-05-27 22:30:10,887 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/LocalLLaMA: Vram 16gig poor. What models do I test?

2026-05-27 22:30:10,897 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: async communication between autonomous profiles

2026-05-27 22:30:12,072 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-05-27 22:30:14,720 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-05-27 22:30:15,662 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/LongbellonRepublic: Longbelion Republic Storyline so far (Will be updated)

2026-05-27 22:30:16,825 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-05-27 22:30:19,056 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-05-27 22:30:19,056 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-05-27 22:30:21,658 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-05-27 22:30:23,984 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-05-27 22:30:26,331 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-05-27 22:30:26,332 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-05-27 22:30:28,299 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 5

2026-05-27 22:30:28,299 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-27 22:30:28,467 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-27 22:30:28,863 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-05-27 22:30:41,268 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-05-27 22:30:54,616 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-05-27 22:31:08,442 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-05-27 22:31:08,443 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-27 22:31:09,025 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-05-27 22:31:09,111 - LinkedInScraper - INFO - New LinkedIn post: Two days trying an open-source agent control plane: great concept, thi

2026-05-27 22:31:10,369 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-05-27 22:31:11,806 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-05-27 22:31:12,007 - LinkedInScraper - INFO - New LinkedIn post: Devv.AI - Developer-centric AI search, augmented by code and docs | Pr

2026-05-27 22:31:12,650 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.

2026-05-27 22:31:12,650 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-05-27 22:31:16,690 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-27 22:31:16,716 - GitHubScraper - INFO - Found 233 GitHub repositories for term: paperclip

2026-05-27 22:31:18,149 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-27 22:31:18,246 - GitHubScraper - INFO - Found 291 GitHub repositories for term: "Hermes Agent"

2026-05-27 22:31:19,346 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-27 22:31:19,350 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica

2026-05-27 22:31:19,524 - GitHubScraper - INFO - Total GitHub results found: 0

2026-05-27 22:31:19,524 - __main__ - INFO - Scraper reddit completed: 10 results

2026-05-27 22:31:19,524 - __main__ - INFO - Scraper github completed: 0 results

2026-05-27 22:31:19,525 - __main__ - INFO - Scraper twitter completed: 0 results

2026-05-27 22:31:19,525 - __main__ - INFO - Scraper linkedin completed: 2 results

2026-05-27 22:31:19,525 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-05-27 22:31:20,154 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-27 22:31:20.154714

2026-05-27 22:31:20,155 - __main__ - INFO - Email sent successfully

2026-05-27 22:31:20,155 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-27 22:31:20,155 - __main__ - INFO - Monitor complete. Found 12 total results: 10 new reddit results, 2 new linkedin results.

2026-05-27 22:31:20,155 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-27 22:31:20,155 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 22:31:20,272 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-27 22:31:20,272 - __main__ - INFO - Closed all database connections

2026-05-27 22:31:20,312 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 22:31:20,324 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-27 23:00:02,720 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-27.log

2026-05-27 23:00:02,720 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-27.log

2026-05-27 23:00:02,720 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-27.log

2026-05-27 23:00:02,720 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-27 23:00:02,744 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-27 23:00:02,744 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-27 23:00:02,746 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-27 23:00:02,747 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-27 23:00:02,781 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-27 23:00:02,781 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-27 23:00:02,825 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-27 23:00:02,829 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-27 23:00:02,829 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-27 23:00:02,850 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-27 23:00:02,850 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-27 23:00:02,850 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-27 23:00:02,853 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-27 23:00:02,857 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-27 23:00:02,857 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-27 23:00:02,860 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-27 23:00:02,860 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-27 23:00:02,860 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-27 23:00:02,860 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-27 23:00:02,860 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-27 23:00:02,860 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-27 23:00:02,952 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-27 23:00:02,961 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-27 23:00:02,961 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-27 23:00:02,963 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-27 23:00:03,304 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-27 23:00:03,843 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-27 23:00:07,078 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-27 23:00:07,260 - Yiddish24Scraper - INFO - Received response with 509236 characters

2026-05-27 23:00:07,263 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318056 chars)

2026-05-27 23:00:07,266 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-27 23:00:07,355 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-27 23:00:07,398 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-27 23:00:07,398 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-27 23:00:07,487 - Yiddish24Scraper - INFO - Term 'הרב' matched in DESCRIPTION: 'הרב לוי פארקאווסקי'

2026-05-27 23:00:07,487 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: אינטערוויו: "איך האב איבערגעמאכט די קבר פון איגא ב

2026-05-27 23:00:08,203 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_297_1779920122.mp3

2026-05-27 23:00:08,275 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_297_1779920122.mp3 (1.5 MB)

2026-05-27 23:00:08,276 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-27 23:00:08,288 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_297_1779920122.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-27 23:00:08,301 - Yiddish24Scraper - INFO - Term 'אייזיק לייב מיללער' matched in DESCRIPTION: 'הרב אייזיק לייב מיללער'

2026-05-27 23:00:08,301 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: לייוו פון סאטמארק: לעבעדיגע באריכטן און גרונטליכע

2026-05-27 23:00:09,203 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_298_1779920156.mp3

2026-05-27 23:00:10,191 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_298_1779920156.mp3 (2.0 MB)

2026-05-27 23:00:10,192 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-27 23:00:10,197 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_298_1779920156.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-27 23:00:10,279 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-27 23:00:10,279 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-27 23:00:10,780 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/052726_yid_260_260527062819.mp3

2026-05-27 23:00:14,063 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_052726_yid_260_260527062819.mp3 (95.6 MB)

2026-05-27 23:00:14,063 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-27 23:00:14,066 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_052726_yid_260_260527062819.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-27 23:00:14,929 - Yiddish24Scraper - INFO - Page 1 summary: 14 new out of 100 total articles

2026-05-27 23:00:14,930 - Yiddish24Scraper - INFO - Page 1: 14/100 new items

2026-05-27 23:00:14,930 - Yiddish24Scraper - INFO - Low new item ratio (14.0%), stopping pagination

2026-05-27 23:00:14,930 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 14

2026-05-27 23:00:15,060 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-27 23:00:35,668 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 10 new posts.

2026-05-27 23:00:35,668 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-27 23:00:35,668 - __main__ - INFO - Scraper yiddish24 completed: 14 results

2026-05-27 23:00:35,668 - __main__ - INFO - Scraper ivelt completed: 10 results

2026-05-27 23:00:36,645 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-27 23:00:36.645822

2026-05-27 23:00:36,646 - __main__ - INFO - Email sent successfully

2026-05-27 23:00:36,646 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-27 23:00:36,646 - __main__ - INFO - Monitor complete. Found 27 total results: 3 new rss results, 14 new yiddish24 results, 10 new ivelt results.

2026-05-27 23:00:36,646 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-27 23:00:36,646 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 23:00:36,755 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-27 23:00:36,756 - __main__ - INFO - Closed all database connections

2026-05-27 23:00:36,757 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-27 23:00:36,757 - social_media_monitor.database.connection - INFO - Closed 0 database connections