← Logs

social_media_monitor_2026-05-21.log

2026-05-21 19:00:02,378 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-21 19:00:02,378 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-21 19:00:02,380 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-21 19:00:02,384 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-21 19:00:02,482 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-21 19:00:02,483 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-21 19:00:02,547 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-21 19:00:02,549 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-21 19:00:02,549 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-21 19:00:02,573 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-21 19:00:02,573 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-21 19:00:02,573 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-21 19:00:02,576 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-21 19:00:02,580 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-21 19:00:02,580 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-21 19:00:02,582 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-21 19:00:02,582 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-21 19:00:02,583 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-21 19:00:02,583 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-21 19:00:02,583 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-21 19:00:02,583 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-21 19:00:02,688 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-21 19:00:02,696 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-21 19:00:02,696 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-21 19:00:02,697 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-21 19:00:03,825 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-21 19:00:04,285 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-21 19:00:07,533 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-21 19:00:07,762 - Yiddish24Scraper - INFO - Received response with 479158 characters

2026-05-21 19:00:07,766 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (312978 chars)

2026-05-21 19:00:07,770 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-21 19:00:07,869 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-21 19:00:07,914 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements

2026-05-21 19:00:07,914 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1

2026-05-21 19:00:08,871 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles

2026-05-21 19:00:08,871 - Yiddish24Scraper - INFO - Page 1: 0/99 new items

2026-05-21 19:00:08,871 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-05-21 19:00:08,871 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-05-21 19:00:14,576 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-21 19:00:31,913 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 33 new posts.

2026-05-21 19:00:31,914 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-21 19:00:31,914 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-05-21 19:00:31,914 - __main__ - INFO - Scraper ivelt completed: 33 results

2026-05-21 19:00:32,603 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-21 19:00:32.603803

2026-05-21 19:00:32,604 - __main__ - INFO - Email sent successfully

2026-05-21 19:00:32,604 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-21 19:00:32,604 - __main__ - INFO - Monitor complete. Found 36 total results: 3 new rss results, 33 new ivelt results.

2026-05-21 19:00:32,604 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-21 19:00:32,604 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 19:00:32,672 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-21 19:00:32,673 - __main__ - INFO - Closed all database connections

2026-05-21 19:00:32,674 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 19:00:32,674 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-21 20:00:02,328 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-21.log

2026-05-21 20:00:02,330 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-21.log

2026-05-21 20:00:02,330 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-21.log

2026-05-21 20:00:02,331 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-21 20:00:02,363 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-21 20:00:02,364 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-21 20:00:02,367 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-21 20:00:02,381 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-21 20:00:02,626 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-21 20:00:02,626 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-21 20:00:02,688 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-21 20:00:02,690 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-21 20:00:02,691 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-21 20:00:02,720 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-21 20:00:02,720 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-21 20:00:02,720 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-21 20:00:02,723 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-21 20:00:02,727 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-21 20:00:02,728 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-21 20:00:02,730 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-21 20:00:02,730 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-21 20:00:02,730 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-21 20:00:02,730 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-21 20:00:02,730 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-21 20:00:02,730 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-21 20:00:02,867 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-21 20:00:02,876 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-21 20:00:02,876 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-21 20:00:02,877 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-21 20:00:03,382 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-21 20:00:03,930 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-21 20:00:14,912 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-21 20:00:24,093 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-21 20:00:24,290 - Yiddish24Scraper - INFO - Received response with 477707 characters

2026-05-21 20:00:24,291 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (310196 chars)

2026-05-21 20:00:24,294 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-21 20:00:24,368 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-21 20:00:24,414 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements

2026-05-21 20:00:24,414 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1

2026-05-21 20:00:24,503 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-21 20:00:24,503 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-21 20:00:25,003 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/thu_nusesv250pbgmmusicm_260_260521032046.mp3

2026-05-21 20:00:26,590 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_thu_nusesv250pbgmmusicm_260_260521032046.mp3 (22.3 MB)

2026-05-21 20:00:26,593 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-21 20:00:26,610 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_thu_nusesv250pbgmmusicm_260_260521032046.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-21 20:00:26,624 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-21 20:00:26,624 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-21 20:00:27,124 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/kipka_260_260521030444.mp3

2026-05-21 20:00:28,610 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_kipka_260_260521030444.mp3 (14.4 MB)

2026-05-21 20:00:28,611 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-21 20:00:28,619 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_kipka_260_260521030444.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-21 20:00:28,628 - Yiddish24Scraper - INFO - Term 'שליט' matched in DESCRIPTION: 'הגה"צ רבי דוד מייזליש שליט"א גאב"ד סיגעיט'

2026-05-21 20:00:28,628 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: אינטערוויו: לכבוד שבועות תשפ"ו: ספעציעלער שמועס אי

2026-05-21 20:00:29,128 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_255_1779392961.mp3

2026-05-21 20:00:30,076 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_255_1779392961.mp3 (4.1 MB)

2026-05-21 20:00:30,078 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-21 20:00:30,081 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_255_1779392961.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-21 20:00:31,066 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 99 total articles

2026-05-21 20:00:31,066 - Yiddish24Scraper - INFO - Page 1: 10/99 new items

2026-05-21 20:00:31,066 - Yiddish24Scraper - INFO - Low new item ratio (10.1%), stopping pagination

2026-05-21 20:00:31,067 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10

2026-05-21 20:00:42,435 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 14 new posts.

2026-05-21 20:00:42,435 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-21 20:00:42,435 - __main__ - INFO - Scraper yiddish24 completed: 10 results

2026-05-21 20:00:42,435 - __main__ - INFO - Scraper ivelt completed: 14 results

2026-05-21 20:00:43,143 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-21 20:00:43.143142

2026-05-21 20:00:43,143 - __main__ - INFO - Email sent successfully

2026-05-21 20:00:43,143 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-21 20:00:43,143 - __main__ - INFO - Monitor complete. Found 27 total results: 3 new rss results, 10 new yiddish24 results, 14 new ivelt results.

2026-05-21 20:00:43,143 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-21 20:00:43,144 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 20:00:43,232 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-21 20:00:43,232 - __main__ - INFO - Closed all database connections

2026-05-21 20:00:43,234 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 20:00:43,234 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-21 20:30:02,019 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-21.log

2026-05-21 20:30:02,020 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-21.log

2026-05-21 20:30:02,020 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-21.log

2026-05-21 20:30:02,021 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-21 20:30:02,044 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-21 20:30:02,044 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-05-21 20:30:02,044 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-21 20:30:02,046 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-21 20:30:02,051 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-21 20:30:02,389 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-21 20:30:02,389 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-21 20:30:02,392 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-21 20:30:02,392 - __main__ - INFO - Reddit scraper initialized and enabled

2026-05-21 20:30:02,392 - __main__ - INFO - GitHub scraper initialized and enabled

2026-05-21 20:30:02,392 - __main__ - INFO - Twitter scraper initialized and enabled

2026-05-21 20:30:02,394 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-21 20:30:02,394 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-05-21 20:30:02,394 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-05-21 20:30:02,398 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-21 20:30:02,398 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-21 20:30:02,414 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-21 20:30:02,418 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-21 20:30:02,418 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-21 20:30:02,420 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-21 20:30:02,420 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-21 20:30:02,420 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-21 20:30:02,420 - __main__ - INFO - Running 5 scrapers concurrently...

2026-05-21 20:30:02,420 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-21 20:30:02,420 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-05-21 20:30:11,599 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-05-21 20:30:11,650 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Am I able to host a LLM on a Beefy VPS or Just use my Gaming PC?

2026-05-21 20:30:11,677 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Building my own AI assistant vs. just using Hermes/openclaw. am I over

2026-05-21 20:30:11,689 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent memory tip: AI agent memory without the stale context tra

2026-05-21 20:30:12,871 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 3

2026-05-21 20:30:12,872 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-05-21 20:30:12,872 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-05-21 20:30:12,872 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-05-21 20:30:15,136 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-05-21 20:30:16,409 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-21 20:30:16,410 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-05-21 20:30:16,410 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-05-21 20:30:16,410 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-05-21 20:30:17,702 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-05-21 20:30:18,982 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-21 20:30:18,982 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-05-21 20:30:18,982 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-05-21 20:30:18,982 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-05-21 20:30:21,560 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-05-21 20:30:23,674 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-05-21 20:30:26,380 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-05-21 20:30:28,608 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-05-21 20:30:28,608 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-05-21 20:30:31,524 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-05-21 20:30:33,742 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-05-21 20:30:35,951 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-05-21 20:30:35,952 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-05-21 20:30:37,993 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0

2026-05-21 20:30:37,993 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-21 20:30:38,156 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-21 20:30:38,629 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-05-21 20:30:53,789 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-05-21 20:31:08,807 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-05-21 20:31:21,256 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-05-21 20:31:21,257 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-21 20:31:21,922 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-05-21 20:31:22,955 - LinkedInScraper - INFO - New LinkedIn post: Paperclip Design - LinkedIn India

2026-05-21 20:31:22,982 - LinkedInScraper - INFO - New LinkedIn post: GitHub - paperclipai/paperclip: The open-source app everyone uses to m

2026-05-21 20:31:23,005 - LinkedInScraper - INFO - New LinkedIn post: Tanya Andrews - Founder & Permit Specialist at PaperClip - LinkedIn

2026-05-21 20:31:23,016 - LinkedInScraper - INFO - New LinkedIn post: GitHub - paperclipai/paperclip: The open-source app everyone uses to m

2026-05-21 20:31:23,028 - LinkedInScraper - INFO - New LinkedIn post: Want to create a company run entirely by AI agents? You might want to

2026-05-21 20:31:23,521 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-05-21 20:31:23,871 - LinkedInScraper - INFO - New LinkedIn post: Just moved my @NousResearch Hermes agent over to Composer 2.5 Fast. Th

2026-05-21 20:31:25,298 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-05-21 20:31:26,202 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 6 new results.

2026-05-21 20:31:26,203 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-05-21 20:31:32,472 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-21 20:31:32,497 - GitHubScraper - INFO - Found 229 GitHub repositories for term: paperclip

2026-05-21 20:31:33,882 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-21 20:31:33,885 - GitHubScraper - INFO - Found 259 GitHub repositories for term: "Hermes Agent"

2026-05-21 20:31:35,322 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-21 20:31:35,414 - GitHubScraper - INFO - Found 47 GitHub repositories for term: multica

2026-05-21 20:31:35,583 - GitHubScraper - INFO - Total GitHub results found: 0

2026-05-21 20:31:35,583 - __main__ - INFO - Scraper reddit completed: 3 results

2026-05-21 20:31:35,583 - __main__ - INFO - Scraper github completed: 0 results

2026-05-21 20:31:35,583 - __main__ - INFO - Scraper twitter completed: 0 results

2026-05-21 20:31:35,583 - __main__ - INFO - Scraper linkedin completed: 6 results

2026-05-21 20:31:35,583 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-05-21 20:31:36,237 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-21 20:31:36.237112

2026-05-21 20:31:36,237 - __main__ - INFO - Email sent successfully

2026-05-21 20:31:36,237 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-21 20:31:36,237 - __main__ - INFO - Monitor complete. Found 9 total results: 3 new reddit results, 6 new linkedin results.

2026-05-21 20:31:36,237 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-21 20:31:36,237 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 20:31:36,356 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-21 20:31:36,356 - __main__ - INFO - Closed all database connections

2026-05-21 20:31:36,397 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 20:31:36,415 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-21 21:00:02,488 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-21.log

2026-05-21 21:00:02,489 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-21.log

2026-05-21 21:00:02,489 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-21.log

2026-05-21 21:00:02,489 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-21 21:00:02,514 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-21 21:00:02,514 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-21 21:00:02,520 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-21 21:00:02,520 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-21 21:00:02,659 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-21 21:00:02,659 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-21 21:00:02,701 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-21 21:00:02,702 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-21 21:00:02,702 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-21 21:00:02,726 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-21 21:00:02,726 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-21 21:00:02,726 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-21 21:00:02,729 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-21 21:00:02,733 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-21 21:00:02,733 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-21 21:00:02,735 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-21 21:00:02,735 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-21 21:00:02,736 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-21 21:00:02,736 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-21 21:00:02,736 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-21 21:00:02,736 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-21 21:00:02,820 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-21 21:00:02,830 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-21 21:00:02,831 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-21 21:00:02,832 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-21 21:00:03,159 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-21 21:00:03,628 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-21 21:00:06,907 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-21 21:00:07,134 - Yiddish24Scraper - INFO - Received response with 473075 characters

2026-05-21 21:00:07,139 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (308206 chars)

2026-05-21 21:00:07,143 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-21 21:00:07,278 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-21 21:00:07,326 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements

2026-05-21 21:00:07,326 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1

2026-05-21 21:00:07,339 - Yiddish24Scraper - INFO - Term 'הכל בכל' matched in TITLE: 'הכל בכל'

2026-05-21 21:00:07,340 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-05-21 21:00:07,840 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/20250531111916129841_11111_260_260521042726.mp3

2026-05-21 21:00:10,806 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_20250531111916129841_11111_260_260521042726.mp3 (82.4 MB)

2026-05-21 21:00:10,807 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-05-21 21:00:10,832 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_20250531111916129841_11111_260_260521042726.mp3: title, artist, album, comment, source_url, genre, publisher

2026-05-21 21:00:11,792 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 99 total articles

2026-05-21 21:00:11,793 - Yiddish24Scraper - INFO - Page 1: 1/99 new items

2026-05-21 21:00:11,793 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination

2026-05-21 21:00:11,793 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1

2026-05-21 21:00:14,743 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-21 21:00:21,387 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 5 new posts.

2026-05-21 21:00:21,388 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-21 21:00:21,388 - __main__ - INFO - Scraper yiddish24 completed: 1 results

2026-05-21 21:00:21,388 - __main__ - INFO - Scraper ivelt completed: 5 results

2026-05-21 21:00:22,009 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-21 21:00:22.009894

2026-05-21 21:00:22,010 - __main__ - INFO - Email sent successfully

2026-05-21 21:00:22,010 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-21 21:00:22,010 - __main__ - INFO - Monitor complete. Found 9 total results: 3 new rss results, 1 new yiddish24 results, 5 new ivelt results.

2026-05-21 21:00:22,010 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-21 21:00:22,010 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 21:00:22,069 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-21 21:00:22,070 - __main__ - INFO - Closed all database connections

2026-05-21 21:00:22,072 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 21:00:22,072 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-21 22:00:02,115 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-21.log

2026-05-21 22:00:02,117 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-21.log

2026-05-21 22:00:02,117 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-21.log

2026-05-21 22:00:02,117 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-21 22:00:02,141 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-21 22:00:02,141 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-21 22:00:02,143 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-21 22:00:02,144 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-21 22:00:02,339 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-21 22:00:02,339 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-21 22:00:02,341 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-21 22:00:02,342 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-21 22:00:02,343 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-21 22:00:02,347 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-21 22:00:02,347 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-21 22:00:02,348 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-21 22:00:02,372 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-21 22:00:02,380 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-21 22:00:02,380 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-21 22:00:02,382 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-21 22:00:02,382 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-21 22:00:02,382 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-21 22:00:02,382 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-21 22:00:02,382 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-21 22:00:02,382 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-21 22:00:02,534 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-21 22:00:02,544 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-21 22:00:02,544 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-21 22:00:02,544 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-21 22:00:02,877 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-21 22:00:03,711 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-21 22:00:06,917 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-21 22:00:07,153 - Yiddish24Scraper - INFO - Received response with 488705 characters

2026-05-21 22:00:07,157 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (312773 chars)

2026-05-21 22:00:07,161 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-21 22:00:07,250 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-21 22:00:07,292 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements

2026-05-21 22:00:07,292 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1

2026-05-21 22:00:08,273 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 99 total articles

2026-05-21 22:00:08,273 - Yiddish24Scraper - INFO - Page 1: 6/99 new items

2026-05-21 22:00:08,273 - Yiddish24Scraper - INFO - Low new item ratio (6.1%), stopping pagination

2026-05-21 22:00:08,273 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-05-21 22:00:14,019 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-21 22:00:30,164 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 13 new posts.

2026-05-21 22:00:30,164 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-21 22:00:30,165 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-05-21 22:00:30,165 - __main__ - INFO - Scraper ivelt completed: 13 results

2026-05-21 22:00:30,852 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-21 22:00:30.852428

2026-05-21 22:00:30,852 - __main__ - INFO - Email sent successfully

2026-05-21 22:00:30,853 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-21 22:00:30,853 - __main__ - INFO - Monitor complete. Found 22 total results: 3 new rss results, 6 new yiddish24 results, 13 new ivelt results.

2026-05-21 22:00:30,853 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-21 22:00:30,853 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 22:00:31,008 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-21 22:00:31,009 - __main__ - INFO - Closed all database connections

2026-05-21 22:00:31,011 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 22:00:31,011 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-21 22:30:03,052 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-21.log

2026-05-21 22:30:03,053 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-21.log

2026-05-21 22:30:03,053 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-21.log

2026-05-21 22:30:03,053 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-21 22:30:03,080 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-21 22:30:03,080 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-05-21 22:30:03,080 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-21 22:30:03,082 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-21 22:30:03,086 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-21 22:30:03,222 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-21 22:30:03,222 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-21 22:30:03,284 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-21 22:30:03,284 - __main__ - INFO - Reddit scraper initialized and enabled

2026-05-21 22:30:03,284 - __main__ - INFO - GitHub scraper initialized and enabled

2026-05-21 22:30:03,284 - __main__ - INFO - Twitter scraper initialized and enabled

2026-05-21 22:30:03,286 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-21 22:30:03,286 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-05-21 22:30:03,286 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-05-21 22:30:03,311 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-21 22:30:03,311 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-21 22:30:03,314 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-21 22:30:03,318 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-21 22:30:03,318 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-21 22:30:03,320 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-21 22:30:03,321 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-21 22:30:03,321 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-21 22:30:03,321 - __main__ - INFO - Running 5 scrapers concurrently...

2026-05-21 22:30:03,321 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-21 22:30:03,321 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-05-21 22:30:04,156 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-05-21 22:30:04,205 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent model routing guide: AI agent memory without the stronges

2026-05-21 22:30:04,224 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Mercury Agent install note: Mercury account safety without the setup-o

2026-05-21 22:30:04,245 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: yeni sistem düzeni

2026-05-21 22:30:05,519 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 3

2026-05-21 22:30:05,519 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-05-21 22:30:05,519 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-05-21 22:30:05,519 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-05-21 22:30:07,622 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-05-21 22:30:08,891 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-21 22:30:08,891 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-05-21 22:30:08,891 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-05-21 22:30:08,891 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-05-21 22:30:11,107 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-05-21 22:30:12,391 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-21 22:30:12,391 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-05-21 22:30:12,391 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-05-21 22:30:12,392 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-05-21 22:30:13,813 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AI_Agents: Proxy for LLMs to learn how Agents works?

2026-05-21 22:30:15,029 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-05-21 22:30:17,134 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: CAPTCHA, GPT & Refusals

2026-05-21 22:30:18,203 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-05-21 22:30:21,163 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-05-21 22:30:23,418 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-05-21 22:30:23,418 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-05-21 22:30:26,001 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-05-21 22:30:28,165 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-05-21 22:30:30,250 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-05-21 22:30:30,250 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-05-21 22:30:32,391 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 2

2026-05-21 22:30:32,392 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-21 22:30:32,552 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-21 22:30:32,979 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-05-21 22:30:46,080 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-05-21 22:30:58,803 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-05-21 22:31:12,414 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-05-21 22:31:12,415 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-21 22:31:12,893 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-05-21 22:31:12,988 - LinkedInScraper - INFO - New LinkedIn post: Paperclip AI Tutorial | Can AI Build Me A Profitable Business In One H

2026-05-21 22:31:14,229 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-05-21 22:31:14,842 - LinkedInScraper - INFO - New LinkedIn post: I’ve just migrated from OpenClaw to Hermes Agent. What, where, who? Th

2026-05-21 22:31:14,858 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent and SkillOS are both trying to make agents improve their

2026-05-21 22:31:16,042 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-05-21 22:31:16,888 - LinkedInScraper - INFO - New LinkedIn post: Paula Loveless - Executive Assistant at MulitiCare Health System - Lin

2026-05-21 22:31:17,050 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 4 new results.

2026-05-21 22:31:17,051 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-05-21 22:31:22,125 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-21 22:31:22,150 - GitHubScraper - INFO - Found 229 GitHub repositories for term: paperclip

2026-05-21 22:31:23,531 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-21 22:31:23,625 - GitHubScraper - INFO - Found 260 GitHub repositories for term: "Hermes Agent"

2026-05-21 22:31:23,701 - GitHubScraper - INFO - Added new GitHub repository: codegraph

2026-05-21 22:31:24,835 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-21 22:31:24,837 - GitHubScraper - INFO - Found 47 GitHub repositories for term: multica

2026-05-21 22:31:25,009 - GitHubScraper - INFO - Total GitHub results found: 1

2026-05-21 22:31:25,010 - __main__ - INFO - Scraper reddit completed: 5 results

2026-05-21 22:31:25,010 - __main__ - INFO - Scraper github completed: 1 results

2026-05-21 22:31:25,010 - __main__ - INFO - Scraper twitter completed: 0 results

2026-05-21 22:31:25,010 - __main__ - INFO - Scraper linkedin completed: 4 results

2026-05-21 22:31:25,010 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-05-21 22:31:25,695 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-21 22:31:25.695801

2026-05-21 22:31:25,696 - __main__ - INFO - Email sent successfully

2026-05-21 22:31:25,696 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-21 22:31:25,696 - __main__ - INFO - Monitor complete. Found 10 total results: 5 new reddit results, 1 new github results, 4 new linkedin results.

2026-05-21 22:31:25,696 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-21 22:31:25,696 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 22:31:25,839 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-21 22:31:25,839 - __main__ - INFO - Closed all database connections

2026-05-21 22:31:25,888 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 22:31:25,902 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-21 23:00:01,980 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-21.log

2026-05-21 23:00:01,980 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-21.log

2026-05-21 23:00:01,980 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-21.log

2026-05-21 23:00:01,980 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-21 23:00:02,004 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-21 23:00:02,004 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-21 23:00:02,007 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-21 23:00:02,007 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-21 23:00:02,242 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-21 23:00:02,242 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-21 23:00:02,245 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-21 23:00:02,246 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-21 23:00:02,247 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-21 23:00:02,253 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled

2026-05-21 23:00:02,253 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0

2026-05-21 23:00:02,253 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-21 23:00:02,281 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-21 23:00:02,288 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-05-21 23:00:02,288 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-05-21 23:00:02,290 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-05-21 23:00:02,290 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-05-21 23:00:02,290 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-21 23:00:02,290 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-21 23:00:02,290 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-21 23:00:02,290 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-21 23:00:02,374 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-21 23:00:02,378 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-21 23:00:02,378 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-21 23:00:02,379 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-21 23:00:02,674 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-21 23:00:03,176 - RSSFeedScraper - INFO - Total RSS/HTML results: 4

2026-05-21 23:00:03,549 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-21 23:00:03,777 - Yiddish24Scraper - INFO - Received response with 488705 characters

2026-05-21 23:00:03,780 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (312773 chars)

2026-05-21 23:00:03,787 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-21 23:00:03,892 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-21 23:00:03,936 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements

2026-05-21 23:00:03,936 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1

2026-05-21 23:00:04,688 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles

2026-05-21 23:00:04,688 - Yiddish24Scraper - INFO - Page 1: 0/99 new items

2026-05-21 23:00:04,688 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-05-21 23:00:04,689 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-05-21 23:00:14,002 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-21 23:00:48,822 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 15 new posts.

2026-05-21 23:00:48,824 - __main__ - INFO - Scraper rss completed: 4 results

2026-05-21 23:00:48,824 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-05-21 23:00:48,824 - __main__ - INFO - Scraper ivelt completed: 15 results

2026-05-21 23:00:49,433 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-21 23:00:49.433597

2026-05-21 23:00:49,433 - __main__ - INFO - Email sent successfully

2026-05-21 23:00:49,435 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-21 23:00:49,435 - __main__ - INFO - Monitor complete. Found 19 total results: 4 new rss results, 15 new ivelt results.

2026-05-21 23:00:49,435 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-21 23:00:49,435 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 23:00:49,688 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-21 23:00:49,688 - __main__ - INFO - Closed all database connections

2026-05-21 23:00:49,689 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-21 23:00:49,689 - social_media_monitor.database.connection - INFO - Closed 0 database connections