← Logs

social_media_monitor_2026-05-18.log

2026-05-18 18:45:06,740 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/x-wav)

2026-05-18 18:45:06,765 - AhBlickLiveScraper - INFO - Downloading video: א מינוט מיט ר' מיילך שליט"א-יום א' ששח"ב שבועות א'

2026-05-18 18:45:07,609 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ahblicklive.com/new_ded_video/26/20/Nous7tudH67ImcdQQ9c/HRok5k/HRok5k.mp4

2026-05-18 18:45:08,085 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: BL_HRok5k.mp4 (9.8 MB)

2026-05-18 18:45:08,085 - social_media_monitor.utils.file_downloader - INFO - Organized video file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Video (video/mp4)

2026-05-18 18:45:08,097 - social_media_monitor.utils.media_tagger - INFO - Tagged BL_HRok5k_2.mp4: title, album, comment, genre

2026-05-18 18:45:08,107 - AhBlickLiveScraper - INFO - Total AhBlickLive results: 4

2026-05-18 18:45:08,107 - __main__ - INFO - Scraper ahblicklive completed: 4 results

2026-05-18 18:45:08,961 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-18 18:45:08.961591

2026-05-18 18:45:08,961 - __main__ - INFO - Email sent successfully

2026-05-18 18:45:08,962 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-18 18:45:08,962 - __main__ - INFO - Monitor complete. Found 4 total results: 4 new ahblicklive results.

2026-05-18 18:45:08,962 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-18 18:45:08,962 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 18:45:08,975 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-18 18:45:08,975 - __main__ - INFO - Closed all database connections

2026-05-18 18:45:08,978 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 18:45:08,979 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-18 19:00:02,034 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-18.log

2026-05-18 19:00:02,034 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-18.log

2026-05-18 19:00:02,034 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-18.log

2026-05-18 19:00:02,035 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-18 19:00:02,058 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-18 19:00:02,058 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-18 19:00:02,060 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-18 19:00:02,061 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-18 19:00:02,221 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-18 19:00:02,222 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-18 19:00:02,270 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-18 19:00:02,271 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-18 19:00:02,272 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-18 19:00:02,294 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-18 19:00:02,294 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-18 19:00:02,294 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-18 19:00:02,299 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-18 19:00:02,304 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-18 19:00:02,304 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-18 19:00:02,306 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-18 19:00:02,306 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-18 19:00:02,306 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-18 19:00:02,306 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-18 19:00:02,306 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-18 19:00:02,306 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-18 19:00:02,403 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-18 19:00:02,408 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-18 19:00:02,408 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-18 19:00:02,409 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-18 19:00:02,848 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-18 19:00:03,284 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-18 19:00:06,840 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-18 19:00:07,060 - Yiddish24Scraper - INFO - Received response with 536778 characters

2026-05-18 19:00:07,063 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (327880 chars)

2026-05-18 19:00:07,067 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-18 19:00:07,153 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-18 19:00:07,194 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-18 19:00:07,194 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-18 19:00:07,976 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles

2026-05-18 19:00:07,976 - Yiddish24Scraper - INFO - Page 1: 6/100 new items

2026-05-18 19:00:07,976 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination

2026-05-18 19:00:07,977 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-05-18 19:00:14,061 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-18 19:00:49,903 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 55 new posts.

2026-05-18 19:00:49,904 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-18 19:00:49,904 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-05-18 19:00:49,904 - __main__ - INFO - Scraper ivelt completed: 55 results

2026-05-18 19:00:50,872 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-18 19:00:50.872051

2026-05-18 19:00:50,872 - __main__ - INFO - Email sent successfully

2026-05-18 19:00:50,872 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-18 19:00:50,872 - __main__ - INFO - Monitor complete. Found 64 total results: 3 new rss results, 6 new yiddish24 results, 55 new ivelt results.

2026-05-18 19:00:50,872 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-18 19:00:50,872 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 19:00:50,983 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-18 19:00:50,984 - __main__ - INFO - Closed all database connections

2026-05-18 19:00:50,986 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 19:00:50,986 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-18 20:00:02,184 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-18.log

2026-05-18 20:00:02,184 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-18.log

2026-05-18 20:00:02,184 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-18.log

2026-05-18 20:00:02,184 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-18 20:00:02,207 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-18 20:00:02,208 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-18 20:00:02,210 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-18 20:00:02,210 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-18 20:00:02,338 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-18 20:00:02,339 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-18 20:00:02,395 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-18 20:00:02,397 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-18 20:00:02,397 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-18 20:00:02,422 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-18 20:00:02,422 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-18 20:00:02,422 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-18 20:00:02,426 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-18 20:00:02,434 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-18 20:00:02,434 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-18 20:00:02,436 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-18 20:00:02,436 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-18 20:00:02,436 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-18 20:00:02,436 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-18 20:00:02,436 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-18 20:00:02,436 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-18 20:00:02,519 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-18 20:00:02,523 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-18 20:00:02,523 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-18 20:00:02,525 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-18 20:00:02,794 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-18 20:00:03,256 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-18 20:00:11,959 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-18 20:00:12,177 - Yiddish24Scraper - INFO - Received response with 532055 characters

2026-05-18 20:00:12,181 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (324971 chars)

2026-05-18 20:00:12,184 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-18 20:00:12,271 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-18 20:00:12,313 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-18 20:00:12,313 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-18 20:00:13,101 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles

2026-05-18 20:00:13,102 - Yiddish24Scraper - INFO - Page 1: 6/100 new items

2026-05-18 20:00:13,102 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination

2026-05-18 20:00:13,102 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-05-18 20:00:14,146 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-18 20:00:30,579 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 38 new posts.

2026-05-18 20:00:30,579 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-18 20:00:30,580 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-05-18 20:00:30,580 - __main__ - INFO - Scraper ivelt completed: 38 results

2026-05-18 20:00:31,361 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-18 20:00:31.361817

2026-05-18 20:00:31,362 - __main__ - INFO - Email sent successfully

2026-05-18 20:00:31,362 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-18 20:00:31,362 - __main__ - INFO - Monitor complete. Found 47 total results: 3 new rss results, 6 new yiddish24 results, 38 new ivelt results.

2026-05-18 20:00:31,362 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-18 20:00:31,362 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 20:00:31,420 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-18 20:00:31,420 - __main__ - INFO - Closed all database connections

2026-05-18 20:00:31,422 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 20:00:31,422 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-18 20:30:01,820 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-18.log

2026-05-18 20:30:01,820 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-18.log

2026-05-18 20:30:01,820 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-18.log

2026-05-18 20:30:01,821 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-18 20:30:01,844 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-18 20:30:01,844 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-05-18 20:30:01,844 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-18 20:30:01,846 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-18 20:30:01,847 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-18 20:30:01,997 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-18 20:30:01,998 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-18 20:30:02,000 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-18 20:30:02,000 - __main__ - INFO - Reddit scraper initialized and enabled

2026-05-18 20:30:02,000 - __main__ - INFO - GitHub scraper initialized and enabled

2026-05-18 20:30:02,000 - __main__ - INFO - Twitter scraper initialized and enabled

2026-05-18 20:30:02,001 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-18 20:30:02,002 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-05-18 20:30:02,002 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-05-18 20:30:02,007 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-18 20:30:02,008 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-18 20:30:02,031 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-18 20:30:02,039 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-18 20:30:02,040 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-18 20:30:02,043 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-18 20:30:02,044 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-18 20:30:02,044 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-18 20:30:02,044 - __main__ - INFO - Running 5 scrapers concurrently...

2026-05-18 20:30:02,044 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-18 20:30:02,044 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-05-18 20:30:03,023 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-05-18 20:30:03,053 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: signal-cli link fails with "Connection closed!"

2026-05-18 20:30:03,079 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent OS Version 14 Makes n8n Look Outdated

2026-05-18 20:30:03,096 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent Install Makes AI Agents Beginner Friendly

2026-05-18 20:30:03,105 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent OS is INSANE! 🤯

2026-05-18 20:30:03,135 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Claude + Hermes Agent OS Changes Everything!

2026-05-18 20:30:03,144 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent + SuperGrok: Build ANYTHING!

2026-05-18 20:30:03,164 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Rank Faster With Hermes Agent FREE SEO Course (2026)

2026-05-18 20:30:03,188 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent FREE AI SEO Tool Is A Wild Ranking System (2026)

2026-05-18 20:30:03,217 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent Latest Version Makes Open Source Agents Useful

2026-05-18 20:30:03,236 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent 3.0 is INSANE!

2026-05-18 20:30:03,262 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Tried every Hermes Agent alternative so you don't have to (2026 roundu

2026-05-18 20:30:04,328 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 11

2026-05-18 20:30:04,329 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-05-18 20:30:04,329 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-05-18 20:30:04,329 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-05-18 20:30:05,613 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-05-18 20:30:06,862 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-18 20:30:06,863 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-05-18 20:30:06,863 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-05-18 20:30:06,863 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-05-18 20:30:10,265 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-05-18 20:30:11,493 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-18 20:30:11,494 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-05-18 20:30:11,494 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-05-18 20:30:11,494 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-05-18 20:30:13,960 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: How To Connect Hermes To Grok AI Without Breaking Your Setup

2026-05-18 20:30:13,994 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Minimax Self Evolving AI Teams Could Run Real Workflows

2026-05-18 20:30:15,109 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-05-18 20:30:17,227 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-05-18 20:30:19,448 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-05-18 20:30:21,635 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-05-18 20:30:21,636 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-05-18 20:30:24,285 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-05-18 20:30:26,436 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-05-18 20:30:28,618 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-05-18 20:30:28,619 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-05-18 20:30:30,622 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 2

2026-05-18 20:30:30,623 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-18 20:30:30,772 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-18 20:30:31,259 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-05-18 20:30:45,957 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-05-18 20:31:00,579 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-05-18 20:31:14,864 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-05-18 20:31:14,865 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-18 20:31:15,584 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-05-18 20:31:16,967 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-05-18 20:31:18,372 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-05-18 20:31:19,113 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.

2026-05-18 20:31:19,113 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-05-18 20:31:23,992 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-18 20:31:24,017 - GitHubScraper - INFO - Found 227 GitHub repositories for term: paperclip

2026-05-18 20:31:25,238 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-18 20:31:25,333 - GitHubScraper - INFO - Found 241 GitHub repositories for term: "Hermes Agent"

2026-05-18 20:31:26,557 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-18 20:31:26,650 - GitHubScraper - INFO - Found 46 GitHub repositories for term: multica

2026-05-18 20:31:26,794 - GitHubScraper - INFO - Total GitHub results found: 0

2026-05-18 20:31:26,795 - __main__ - INFO - Scraper reddit completed: 13 results

2026-05-18 20:31:26,795 - __main__ - INFO - Scraper github completed: 0 results

2026-05-18 20:31:26,795 - __main__ - INFO - Scraper twitter completed: 0 results

2026-05-18 20:31:26,795 - __main__ - INFO - Scraper linkedin completed: 0 results

2026-05-18 20:31:26,795 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-05-18 20:31:27,476 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-18 20:31:27.476148

2026-05-18 20:31:27,476 - __main__ - INFO - Email sent successfully

2026-05-18 20:31:27,476 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-18 20:31:27,476 - __main__ - INFO - Monitor complete. Found 13 total results: 13 new reddit results.

2026-05-18 20:31:27,476 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-18 20:31:27,476 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 20:31:27,614 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-18 20:31:27,615 - __main__ - INFO - Closed all database connections

2026-05-18 20:31:27,668 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 20:31:27,686 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-18 21:00:02,439 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-18.log

2026-05-18 21:00:02,439 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-18.log

2026-05-18 21:00:02,439 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-18.log

2026-05-18 21:00:02,439 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-18 21:00:02,462 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-18 21:00:02,462 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-18 21:00:02,464 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-18 21:00:02,465 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-18 21:00:02,590 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-18 21:00:02,590 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-18 21:00:02,649 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-18 21:00:02,651 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-18 21:00:02,651 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-18 21:00:02,671 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-18 21:00:02,671 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-18 21:00:02,671 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-18 21:00:02,675 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-18 21:00:02,679 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-18 21:00:02,679 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-18 21:00:02,681 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-18 21:00:02,681 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-18 21:00:02,682 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-18 21:00:02,682 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-18 21:00:02,682 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-18 21:00:02,682 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-18 21:00:02,770 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-18 21:00:02,774 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-18 21:00:02,775 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-18 21:00:02,776 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-18 21:00:03,079 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-18 21:00:03,887 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-18 21:00:07,425 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-18 21:00:07,679 - Yiddish24Scraper - INFO - Received response with 529879 characters

2026-05-18 21:00:07,683 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (323606 chars)

2026-05-18 21:00:07,686 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-18 21:00:07,776 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-18 21:00:07,815 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-18 21:00:07,815 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-18 21:00:08,610 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles

2026-05-18 21:00:08,611 - Yiddish24Scraper - INFO - Page 1: 6/100 new items

2026-05-18 21:00:08,611 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination

2026-05-18 21:00:08,611 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-05-18 21:00:14,570 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-18 21:00:39,274 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 58 new posts.

2026-05-18 21:00:39,274 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-18 21:00:39,274 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-05-18 21:00:39,274 - __main__ - INFO - Scraper ivelt completed: 58 results

2026-05-18 21:00:40,143 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-18 21:00:40.143679

2026-05-18 21:00:40,144 - __main__ - INFO - Email sent successfully

2026-05-18 21:00:40,144 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-18 21:00:40,144 - __main__ - INFO - Monitor complete. Found 67 total results: 3 new rss results, 6 new yiddish24 results, 58 new ivelt results.

2026-05-18 21:00:40,144 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-18 21:00:40,144 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 21:00:40,226 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-18 21:00:40,227 - __main__ - INFO - Closed all database connections

2026-05-18 21:00:40,229 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 21:00:40,229 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-18 22:00:02,055 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-18.log

2026-05-18 22:00:02,055 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-18.log

2026-05-18 22:00:02,055 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-18.log

2026-05-18 22:00:02,055 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-18 22:00:02,078 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-18 22:00:02,078 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-18 22:00:02,081 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-18 22:00:02,081 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-18 22:00:02,250 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-18 22:00:02,250 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-18 22:00:02,252 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-18 22:00:02,254 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-18 22:00:02,254 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-18 22:00:02,260 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-18 22:00:02,260 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-18 22:00:02,260 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-18 22:00:02,279 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-18 22:00:02,283 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-18 22:00:02,283 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-18 22:00:02,285 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-18 22:00:02,285 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-18 22:00:02,285 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-18 22:00:02,285 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-18 22:00:02,285 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-18 22:00:02,286 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-18 22:00:02,371 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-18 22:00:02,376 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-18 22:00:02,376 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-18 22:00:02,377 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-18 22:00:02,669 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-18 22:00:04,915 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-05-18 22:00:10,143 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-18 22:00:10,389 - Yiddish24Scraper - INFO - Received response with 536274 characters

2026-05-18 22:00:10,392 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (326944 chars)

2026-05-18 22:00:10,395 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-18 22:00:10,492 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-18 22:00:10,539 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-18 22:00:10,539 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-18 22:00:11,506 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles

2026-05-18 22:00:11,506 - Yiddish24Scraper - INFO - Page 1: 6/100 new items

2026-05-18 22:00:11,506 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination

2026-05-18 22:00:11,506 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6

2026-05-18 22:00:13,858 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-18 22:00:38,876 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 29 new posts.

2026-05-18 22:00:38,876 - __main__ - INFO - Scraper rss completed: 3 results

2026-05-18 22:00:38,876 - __main__ - INFO - Scraper yiddish24 completed: 6 results

2026-05-18 22:00:38,876 - __main__ - INFO - Scraper ivelt completed: 29 results

2026-05-18 22:00:39,590 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-18 22:00:39.590594

2026-05-18 22:00:39,590 - __main__ - INFO - Email sent successfully

2026-05-18 22:00:39,591 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-18 22:00:39,591 - __main__ - INFO - Monitor complete. Found 38 total results: 3 new rss results, 6 new yiddish24 results, 29 new ivelt results.

2026-05-18 22:00:39,591 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-18 22:00:39,591 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 22:00:39,731 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-18 22:00:39,731 - __main__ - INFO - Closed all database connections

2026-05-18 22:00:39,733 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 22:00:39,733 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-18 22:30:02,108 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-18.log

2026-05-18 22:30:02,108 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-18.log

2026-05-18 22:30:02,108 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-18.log

2026-05-18 22:30:02,108 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-18 22:30:02,133 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-18 22:30:02,133 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-05-18 22:30:02,133 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-18 22:30:02,135 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-18 22:30:02,136 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-18 22:30:02,264 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-18 22:30:02,264 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-18 22:30:02,309 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-18 22:30:02,309 - __main__ - INFO - Reddit scraper initialized and enabled

2026-05-18 22:30:02,310 - __main__ - INFO - GitHub scraper initialized and enabled

2026-05-18 22:30:02,310 - __main__ - INFO - Twitter scraper initialized and enabled

2026-05-18 22:30:02,311 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-18 22:30:02,312 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-05-18 22:30:02,312 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-05-18 22:30:02,334 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-18 22:30:02,334 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-18 22:30:02,337 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-18 22:30:02,342 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-18 22:30:02,342 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-18 22:30:02,344 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-18 22:30:02,344 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-18 22:30:02,344 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-18 22:30:02,344 - __main__ - INFO - Running 5 scrapers concurrently...

2026-05-18 22:30:02,344 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-18 22:30:02,344 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-05-18 22:30:03,344 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-05-18 22:30:03,370 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: AutoGPT: Automating GPT Model for Natural Language Generation

2026-05-18 22:30:03,392 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes agent not working as expected!

2026-05-18 22:30:03,402 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Which is the best model ?

2026-05-18 22:30:04,660 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 3

2026-05-18 22:30:04,660 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-05-18 22:30:04,661 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-05-18 22:30:04,661 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-05-18 22:30:05,842 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-05-18 22:30:05,880 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Looking for advice about stitched injury recovery for my cat

2026-05-18 22:30:07,024 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1

2026-05-18 22:30:07,024 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-05-18 22:30:07,024 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-05-18 22:30:07,024 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-05-18 22:30:07,933 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-05-18 22:30:09,211 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-05-18 22:30:09,212 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-05-18 22:30:09,212 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-05-18 22:30:09,212 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-05-18 22:30:10,107 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Storing secrets

2026-05-18 22:30:11,397 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-05-18 22:30:13,528 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-05-18 22:30:15,804 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-05-18 22:30:17,794 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-05-18 22:30:17,794 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-05-18 22:30:20,191 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-05-18 22:30:22,307 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-05-18 22:30:24,432 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-05-18 22:30:24,433 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-05-18 22:30:26,687 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 1

2026-05-18 22:30:26,688 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-18 22:30:26,807 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-18 22:30:27,247 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-05-18 22:30:41,421 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-05-18 22:30:55,635 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-05-18 22:31:09,729 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-05-18 22:31:09,729 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-05-18 22:31:10,277 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-05-18 22:31:11,724 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-05-18 22:31:13,063 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-05-18 22:31:13,353 - LinkedInScraper - INFO - New LinkedIn post: What a great weekend of coding: Tamaton vibe coding update. Tamaton OS

2026-05-18 22:31:13,801 - LinkedInScraper - INFO - New LinkedIn post: Helping patients transition safely from hospital to home - LinkedIn

2026-05-18 22:31:13,990 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.

2026-05-18 22:31:13,991 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-05-18 22:31:19,722 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-18 22:31:19,747 - GitHubScraper - INFO - Found 227 GitHub repositories for term: paperclip

2026-05-18 22:31:21,269 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-18 22:31:21,364 - GitHubScraper - INFO - Found 242 GitHub repositories for term: "Hermes Agent"

2026-05-18 22:31:21,410 - GitHubScraper - INFO - Added new GitHub repository: Autonomous-Agents

2026-05-18 22:31:22,734 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-05-18 22:31:22,824 - GitHubScraper - INFO - Found 46 GitHub repositories for term: multica

2026-05-18 22:31:23,007 - GitHubScraper - INFO - Total GitHub results found: 1

2026-05-18 22:31:23,007 - __main__ - INFO - Scraper reddit completed: 5 results

2026-05-18 22:31:23,008 - __main__ - INFO - Scraper github completed: 1 results

2026-05-18 22:31:23,008 - __main__ - INFO - Scraper twitter completed: 0 results

2026-05-18 22:31:23,008 - __main__ - INFO - Scraper linkedin completed: 2 results

2026-05-18 22:31:23,008 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-05-18 22:31:23,588 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-18 22:31:23.588656

2026-05-18 22:31:23,588 - __main__ - INFO - Email sent successfully

2026-05-18 22:31:23,589 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-18 22:31:23,589 - __main__ - INFO - Monitor complete. Found 8 total results: 5 new reddit results, 1 new github results, 2 new linkedin results.

2026-05-18 22:31:23,589 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-18 22:31:23,589 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 22:31:23,700 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-18 22:31:23,700 - __main__ - INFO - Closed all database connections

2026-05-18 22:31:23,736 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 22:31:23,750 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-05-18 23:00:02,550 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-18.log

2026-05-18 23:00:02,550 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-18.log

2026-05-18 23:00:02,550 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-18.log

2026-05-18 23:00:02,550 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-05-18 23:00:02,576 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-05-18 23:00:02,576 - __main__ - INFO - Configuration loaded and validated successfully

2026-05-18 23:00:02,578 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-05-18 23:00:02,579 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-05-18 23:00:02,734 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-05-18 23:00:02,734 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-05-18 23:00:02,736 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-05-18 23:00:02,737 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0

2026-05-18 23:00:02,738 - __main__ - INFO - RSS scraper initialized and enabled

2026-05-18 23:00:02,743 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled

2026-05-18 23:00:02,743 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0

2026-05-18 23:00:02,743 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-05-18 23:00:02,766 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0

2026-05-18 23:00:02,776 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled

2026-05-18 23:00:02,776 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0

2026-05-18 23:00:02,780 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled

2026-05-18 23:00:02,780 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0

2026-05-18 23:00:02,780 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-05-18 23:00:02,780 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-05-18 23:00:02,780 - __main__ - INFO - Running 3 scrapers concurrently...

2026-05-18 23:00:02,781 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-05-18 23:00:02,861 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-05-18 23:00:02,865 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters

2026-05-18 23:00:02,865 - IveltScraper - INFO - Fetching ivelt.com active topics...

2026-05-18 23:00:02,866 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-05-18 23:00:03,156 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-05-18 23:00:03,606 - RSSFeedScraper - INFO - Total RSS/HTML results: 4

2026-05-18 23:00:06,811 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-05-18 23:00:07,050 - Yiddish24Scraper - INFO - Received response with 536947 characters

2026-05-18 23:00:07,054 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (327090 chars)

2026-05-18 23:00:07,057 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-05-18 23:00:07,147 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-05-18 23:00:07,187 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-05-18 23:00:07,187 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-05-18 23:00:08,059 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles

2026-05-18 23:00:08,059 - Yiddish24Scraper - INFO - Page 1: 5/100 new items

2026-05-18 23:00:08,059 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination

2026-05-18 23:00:08,059 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5

2026-05-18 23:00:14,491 - IveltScraper - INFO - Found 50 active topics on ivelt.com

2026-05-18 23:00:20,602 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 5 new posts.

2026-05-18 23:00:20,602 - __main__ - INFO - Scraper rss completed: 4 results

2026-05-18 23:00:20,602 - __main__ - INFO - Scraper yiddish24 completed: 5 results

2026-05-18 23:00:20,602 - __main__ - INFO - Scraper ivelt completed: 5 results

2026-05-18 23:00:21,253 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-18 23:00:21.253141

2026-05-18 23:00:21,253 - __main__ - INFO - Email sent successfully

2026-05-18 23:00:21,253 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-05-18 23:00:21,253 - __main__ - INFO - Monitor complete. Found 14 total results: 4 new rss results, 5 new yiddish24 results, 5 new ivelt results.

2026-05-18 23:00:21,253 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-05-18 23:00:21,253 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 23:00:21,317 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-05-18 23:00:21,318 - __main__ - INFO - Closed all database connections

2026-05-18 23:00:21,320 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-05-18 23:00:21,320 - social_media_monitor.database.connection - INFO - Closed 0 database connections