← Logs

social_media_monitor_2026-06-06.log

2026-06-06 19:00:01,867 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-06.log

2026-06-06 19:00:01,867 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-06.log

2026-06-06 19:00:01,867 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-06 19:00:01,903 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-06 19:00:01,903 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-06 19:00:01,905 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-06 19:00:01,906 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-06 19:00:01,942 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-06 19:00:01,942 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-06 19:00:01,943 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-06 19:00:01,944 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-06 19:00:01,944 - __main__ - INFO - RSS scraper initialized and enabled

2026-06-06 19:00:01,946 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled

2026-06-06 19:00:01,947 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0

2026-06-06 19:00:01,947 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-06-06 19:00:01,949 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-06 19:00:01,955 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-06-06 19:00:01,955 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-06-06 19:00:01,957 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-06 19:00:01,957 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-06-06 19:00:01,957 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-06 19:00:01,958 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-06-06 19:00:01,958 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-06 19:00:01,958 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-06-06 19:00:02,040 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-06-06 19:00:02,044 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters

2026-06-06 19:00:02,044 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-06-06 19:00:02,045 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-06-06 19:00:02,438 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-06-06 19:00:02,936 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-06-06 19:00:03,330 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-06-06 19:00:03,498 - Yiddish24Scraper - INFO - Received response with 452738 characters

2026-06-06 19:00:03,500 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (299562 chars)

2026-06-06 19:00:03,502 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-06-06 19:00:03,587 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-06-06 19:00:03,625 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-06-06 19:00:03,625 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-06-06 19:00:04,699 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-06-06 19:00:04,699 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-06-06 19:00:04,699 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-06-06 19:00:04,700 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-06-06 19:00:13,802 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-06-06 19:00:41,778 - IveltScraper - INFO - ivelt scrape complete. Checked 7 topics.

2026-06-06 19:00:41,778 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...

2026-06-06 19:00:42,631 - IveltScraper - INFO - Found 50 active topics on yidtish

2026-06-06 19:00:46,551 - IveltScraper - INFO - yidtish scrape complete. Checked 3 topics.

2026-06-06 19:00:46,551 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.

2026-06-06 19:00:46,552 - __main__ - INFO - Scraper rss completed: 3 results

2026-06-06 19:00:46,552 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-06-06 19:00:46,552 - __main__ - INFO - Scraper ivelt completed: 0 results

2026-06-06 19:00:47,248 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-06 19:00:47.248922

2026-06-06 19:00:47,249 - __main__ - INFO - Email sent successfully

2026-06-06 19:00:47,249 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-06 19:00:47,249 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.

2026-06-06 19:00:47,249 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-06 19:00:47,249 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 19:00:47,341 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-06 19:00:47,341 - __main__ - INFO - Closed all database connections

2026-06-06 19:00:47,344 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 19:00:47,344 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-06 20:00:02,516 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-06.log

2026-06-06 20:00:02,516 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-06.log

2026-06-06 20:00:02,516 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-06.log

2026-06-06 20:00:02,516 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-06 20:00:02,555 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-06 20:00:02,555 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-06 20:00:02,557 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-06 20:00:02,558 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-06 20:00:02,571 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-06 20:00:02,571 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-06 20:00:02,617 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-06 20:00:02,617 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-06 20:00:02,618 - __main__ - INFO - RSS scraper initialized and enabled

2026-06-06 20:00:02,620 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled

2026-06-06 20:00:02,620 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0

2026-06-06 20:00:02,620 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-06-06 20:00:02,622 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-06 20:00:02,626 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-06-06 20:00:02,626 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-06-06 20:00:02,629 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-06 20:00:02,629 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-06-06 20:00:02,629 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-06 20:00:02,629 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-06-06 20:00:02,629 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-06 20:00:02,629 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-06-06 20:00:02,738 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-06-06 20:00:02,742 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters

2026-06-06 20:00:02,743 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-06-06 20:00:02,745 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-06-06 20:00:03,077 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-06-06 20:00:03,521 - RSSFeedScraper - INFO - Total RSS/HTML results: 2

2026-06-06 20:00:03,893 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-06-06 20:00:04,063 - Yiddish24Scraper - INFO - Received response with 452738 characters

2026-06-06 20:00:04,065 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (299562 chars)

2026-06-06 20:00:04,068 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-06-06 20:00:04,150 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-06-06 20:00:04,189 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-06-06 20:00:04,189 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-06-06 20:00:05,067 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-06-06 20:00:05,068 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-06-06 20:00:05,068 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-06-06 20:00:05,068 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-06-06 20:00:14,396 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-06-06 20:00:37,824 - IveltScraper - INFO - ivelt scrape complete. Checked 7 topics.

2026-06-06 20:00:37,824 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...

2026-06-06 20:00:38,683 - IveltScraper - INFO - Found 50 active topics on yidtish

2026-06-06 20:00:42,534 - IveltScraper - INFO - yidtish scrape complete. Checked 3 topics.

2026-06-06 20:00:42,534 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.

2026-06-06 20:00:42,535 - __main__ - INFO - Scraper rss completed: 2 results

2026-06-06 20:00:42,535 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-06-06 20:00:42,535 - __main__ - INFO - Scraper ivelt completed: 0 results

2026-06-06 20:00:43,229 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-06 20:00:43.229907

2026-06-06 20:00:43,230 - __main__ - INFO - Email sent successfully

2026-06-06 20:00:43,230 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-06 20:00:43,230 - __main__ - INFO - Monitor complete. Found 2 total results: 2 new rss results.

2026-06-06 20:00:43,230 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-06 20:00:43,230 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 20:00:43,280 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-06 20:00:43,281 - __main__ - INFO - Closed all database connections

2026-06-06 20:00:43,283 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 20:00:43,283 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-06 20:30:01,964 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-06.log

2026-06-06 20:30:01,964 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-06.log

2026-06-06 20:30:01,964 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-06.log

2026-06-06 20:30:01,964 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-06 20:30:02,001 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-06 20:30:02,001 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-06-06 20:30:02,001 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-06 20:30:02,004 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-06 20:30:02,004 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-06 20:30:02,038 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-06 20:30:02,038 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-06 20:30:02,039 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-06 20:30:02,039 - __main__ - INFO - Reddit scraper initialized and enabled

2026-06-06 20:30:02,039 - __main__ - INFO - GitHub scraper initialized and enabled

2026-06-06 20:30:02,039 - __main__ - INFO - Twitter scraper initialized and enabled

2026-06-06 20:30:02,040 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-06 20:30:02,040 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-06-06 20:30:02,040 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-06-06 20:30:02,042 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled

2026-06-06 20:30:02,042 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0

2026-06-06 20:30:02,045 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-06 20:30:02,049 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-06-06 20:30:02,049 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-06-06 20:30:02,052 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-06 20:30:02,052 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-06-06 20:30:02,052 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-06 20:30:02,052 - __main__ - INFO - Running 5 scrapers concurrently...

2026-06-06 20:30:02,052 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-06 20:30:02,052 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-06-06 20:30:02,902 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-06-06 20:30:03,118 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent 5.0 (New Upgrades): HERMES BECAME ULTRA-HERMES!

2026-06-06 20:30:04,346 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1

2026-06-06 20:30:04,347 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-06-06 20:30:04,347 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-06-06 20:30:04,347 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-06-06 20:30:05,395 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-06-06 20:30:06,581 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-06-06 20:30:06,581 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-06-06 20:30:06,582 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-06-06 20:30:06,582 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-06-06 20:30:07,374 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-06-06 20:30:08,617 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-06-06 20:30:08,618 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-06-06 20:30:08,618 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-06-06 20:30:08,618 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-06-06 20:30:09,505 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Somewhat disappointed

2026-06-06 20:30:10,618 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-06-06 20:30:12,861 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-06-06 20:30:13,912 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Conversation history deleted upon compaction.

2026-06-06 20:30:13,921 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/worldbuilding: An introduction to my worldbuilding project: "The Pax Humana"

2026-06-06 20:30:15,062 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-06-06 20:30:17,001 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-06-06 20:30:17,002 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-06-06 20:30:19,540 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-06-06 20:30:21,929 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-06-06 20:30:24,015 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-06-06 20:30:24,016 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-06-06 20:30:25,934 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 3

2026-06-06 20:30:25,935 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-06 20:30:26,058 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-06 20:30:26,482 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-06-06 20:30:41,190 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-06-06 20:30:55,425 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-06-06 20:31:09,226 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-06-06 20:31:09,227 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-06 20:31:09,813 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-06-06 20:31:11,259 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-06-06 20:31:11,646 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent (Nous Research) quietly became my social media manager, i

2026-06-06 20:31:12,541 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-06-06 20:31:13,263 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 1 new results.

2026-06-06 20:31:13,264 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-06-06 20:31:18,908 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-06 20:31:18,933 - GitHubScraper - INFO - Found 236 GitHub repositories for term: paperclip

2026-06-06 20:31:19,919 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-06 20:31:19,922 - GitHubScraper - INFO - Found 329 GitHub repositories for term: "Hermes Agent"

2026-06-06 20:31:21,014 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-06 20:31:21,017 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica

2026-06-06 20:31:21,143 - GitHubScraper - INFO - Total GitHub results found: 0

2026-06-06 20:31:21,143 - __main__ - INFO - Scraper reddit completed: 4 results

2026-06-06 20:31:21,143 - __main__ - INFO - Scraper github completed: 0 results

2026-06-06 20:31:21,143 - __main__ - INFO - Scraper twitter completed: 0 results

2026-06-06 20:31:21,144 - __main__ - INFO - Scraper linkedin completed: 1 results

2026-06-06 20:31:21,144 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-06-06 20:31:21,822 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-06 20:31:21.822533

2026-06-06 20:31:21,822 - __main__ - INFO - Email sent successfully

2026-06-06 20:31:21,822 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-06 20:31:21,822 - __main__ - INFO - Monitor complete. Found 5 total results: 4 new reddit results, 1 new linkedin results.

2026-06-06 20:31:21,822 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-06 20:31:21,823 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 20:31:21,917 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-06 20:31:21,917 - __main__ - INFO - Closed all database connections

2026-06-06 20:31:21,957 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 20:31:21,969 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-06 21:00:01,891 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-06.log

2026-06-06 21:00:01,891 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-06.log

2026-06-06 21:00:01,891 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-06.log

2026-06-06 21:00:01,891 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-06 21:00:01,925 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-06 21:00:01,926 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-06 21:00:01,928 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-06 21:00:01,928 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-06 21:00:01,987 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-06 21:00:01,987 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-06 21:00:01,988 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-06 21:00:01,989 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-06 21:00:01,989 - __main__ - INFO - RSS scraper initialized and enabled

2026-06-06 21:00:01,991 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled

2026-06-06 21:00:01,991 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0

2026-06-06 21:00:01,991 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-06-06 21:00:01,994 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-06 21:00:01,998 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-06-06 21:00:01,998 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-06-06 21:00:02,000 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-06 21:00:02,000 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-06-06 21:00:02,001 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-06 21:00:02,001 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-06-06 21:00:02,001 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-06 21:00:02,001 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-06-06 21:00:02,102 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-06-06 21:00:02,106 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters

2026-06-06 21:00:02,106 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-06-06 21:00:02,108 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-06-06 21:00:02,646 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-06-06 21:00:03,263 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-06-06 21:00:03,631 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-06-06 21:00:03,800 - Yiddish24Scraper - INFO - Received response with 452738 characters

2026-06-06 21:00:03,802 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (299562 chars)

2026-06-06 21:00:03,804 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-06-06 21:00:03,896 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-06-06 21:00:03,938 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-06-06 21:00:03,938 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-06-06 21:00:04,617 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-06-06 21:00:04,617 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-06-06 21:00:04,617 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-06-06 21:00:04,617 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-06-06 21:00:14,692 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-06-06 21:00:38,768 - IveltScraper - INFO - ivelt scrape complete. Checked 7 topics.

2026-06-06 21:00:38,768 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...

2026-06-06 21:00:39,657 - IveltScraper - INFO - Found 50 active topics on yidtish

2026-06-06 21:00:43,460 - IveltScraper - INFO - yidtish scrape complete. Checked 3 topics.

2026-06-06 21:00:43,460 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.

2026-06-06 21:00:43,461 - __main__ - INFO - Scraper rss completed: 3 results

2026-06-06 21:00:43,461 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-06-06 21:00:43,461 - __main__ - INFO - Scraper ivelt completed: 0 results

2026-06-06 21:00:43,973 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-06 21:00:43.973749

2026-06-06 21:00:43,974 - __main__ - INFO - Email sent successfully

2026-06-06 21:00:43,974 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-06 21:00:43,974 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.

2026-06-06 21:00:43,974 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-06 21:00:43,974 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 21:00:44,043 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-06 21:00:44,044 - __main__ - INFO - Closed all database connections

2026-06-06 21:00:44,046 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 21:00:44,046 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-06 22:00:01,752 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-06.log

2026-06-06 22:00:01,752 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-06.log

2026-06-06 22:00:01,752 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-06.log

2026-06-06 22:00:01,752 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-06 22:00:01,787 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-06 22:00:01,787 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-06 22:00:01,789 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-06 22:00:01,790 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-06 22:00:01,828 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-06 22:00:01,829 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-06 22:00:01,871 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-06 22:00:01,873 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-06 22:00:01,873 - __main__ - INFO - RSS scraper initialized and enabled

2026-06-06 22:00:01,877 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled

2026-06-06 22:00:01,877 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0

2026-06-06 22:00:01,877 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-06-06 22:00:01,879 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-06 22:00:01,883 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-06-06 22:00:01,883 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-06-06 22:00:01,885 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-06 22:00:01,885 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-06-06 22:00:01,886 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-06 22:00:01,886 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-06-06 22:00:01,886 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-06 22:00:01,886 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-06-06 22:00:01,971 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-06-06 22:00:01,975 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters

2026-06-06 22:00:01,975 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-06-06 22:00:01,976 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-06-06 22:00:02,512 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-06-06 22:00:03,145 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-06-06 22:00:03,532 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-06-06 22:00:03,701 - Yiddish24Scraper - INFO - Received response with 452738 characters

2026-06-06 22:00:03,704 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (299562 chars)

2026-06-06 22:00:03,706 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-06-06 22:00:03,782 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-06-06 22:00:03,821 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-06-06 22:00:03,821 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-06-06 22:00:04,563 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-06-06 22:00:04,563 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-06-06 22:00:04,563 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-06-06 22:00:04,564 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-06-06 22:00:13,645 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-06-06 22:00:36,763 - IveltScraper - INFO - ivelt scrape complete. Checked 7 topics.

2026-06-06 22:00:36,763 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...

2026-06-06 22:00:37,598 - IveltScraper - INFO - Found 50 active topics on yidtish

2026-06-06 22:00:41,413 - IveltScraper - INFO - yidtish scrape complete. Checked 3 topics.

2026-06-06 22:00:41,413 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.

2026-06-06 22:00:41,414 - __main__ - INFO - Scraper rss completed: 3 results

2026-06-06 22:00:41,414 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-06-06 22:00:41,414 - __main__ - INFO - Scraper ivelt completed: 0 results

2026-06-06 22:00:42,043 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-06 22:00:42.043265

2026-06-06 22:00:42,043 - __main__ - INFO - Email sent successfully

2026-06-06 22:00:42,043 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-06 22:00:42,044 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.

2026-06-06 22:00:42,044 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-06 22:00:42,044 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 22:00:42,099 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-06 22:00:42,099 - __main__ - INFO - Closed all database connections

2026-06-06 22:00:42,102 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 22:00:42,102 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-06 22:30:01,624 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-06.log

2026-06-06 22:30:01,624 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-06.log

2026-06-06 22:30:01,624 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-06.log

2026-06-06 22:30:01,624 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-06 22:30:01,658 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-06 22:30:01,659 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented

2026-06-06 22:30:01,659 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-06 22:30:01,661 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-06 22:30:01,661 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-06 22:30:01,679 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-06 22:30:01,679 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-06 22:30:01,680 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-06 22:30:01,680 - __main__ - INFO - Reddit scraper initialized and enabled

2026-06-06 22:30:01,680 - __main__ - INFO - GitHub scraper initialized and enabled

2026-06-06 22:30:01,680 - __main__ - INFO - Twitter scraper initialized and enabled

2026-06-06 22:30:01,681 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-06 22:30:01,681 - __main__ - INFO - LinkedIn scraper initialized and enabled

2026-06-06 22:30:01,681 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-06-06 22:30:01,683 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled

2026-06-06 22:30:01,683 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0

2026-06-06 22:30:01,686 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-06 22:30:01,690 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-06-06 22:30:01,690 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-06-06 22:30:01,692 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-06 22:30:01,694 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-06-06 22:30:01,694 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-06 22:30:01,694 - __main__ - INFO - Running 5 scrapers concurrently...

2026-06-06 22:30:01,694 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-06 22:30:01,694 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']

2026-06-06 22:30:02,562 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'

2026-06-06 22:30:02,596 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Where to find the new Desktop App on Linux/Ubuntu?

2026-06-06 22:30:02,611 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Mercury Agent install note: Mercury Telegram agent without the setup-o

2026-06-06 22:30:03,808 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2

2026-06-06 22:30:03,808 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']

2026-06-06 22:30:03,808 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']

2026-06-06 22:30:03,808 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI

2026-06-06 22:30:05,495 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'

2026-06-06 22:30:05,859 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Paperclip games

2026-06-06 22:30:07,074 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1

2026-06-06 22:30:07,074 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']

2026-06-06 22:30:07,074 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']

2026-06-06 22:30:07,075 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI

2026-06-06 22:30:08,110 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'

2026-06-06 22:30:09,365 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0

2026-06-06 22:30:09,365 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.

2026-06-06 22:30:09,365 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)

2026-06-06 22:30:09,366 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS

2026-06-06 22:30:10,177 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: What am I missing?

2026-06-06 22:30:10,200 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: WebUI Tool Call Issue

2026-06-06 22:30:10,211 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Hermes’ for coding?

2026-06-06 22:30:11,369 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS

2026-06-06 22:30:12,703 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/github: How do these AI repos gain SO many stars so quickly without that much

2026-06-06 22:30:13,840 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS

2026-06-06 22:30:15,006 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/Starcitizen_trades: 🏗️🚀✨🪐 𝐕𝐄𝐒𝐒𝐄𝐋𝐘𝐀𝐑𝐃 & 𝐔𝐏𝐆𝐑𝐀𝐃𝐄 𝐃𝐎𝐂𝐊 🛠️ ⭐𝙎𝙋𝙀𝘾𝙄𝘼𝙇 𝙊𝙁𝙁𝙀𝙍𝙎⭐⎮POLARIS $495⎮PRESE

2026-06-06 22:30:16,137 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS

2026-06-06 22:30:18,273 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)

2026-06-06 22:30:18,274 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS

2026-06-06 22:30:20,800 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS

2026-06-06 22:30:23,143 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS

2026-06-06 22:30:25,093 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)

2026-06-06 22:30:25,094 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS

2026-06-06 22:30:27,284 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 5

2026-06-06 22:30:27,285 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-06 22:30:27,405 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-06 22:30:27,815 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'

2026-06-06 22:30:41,693 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'

2026-06-06 22:30:55,760 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'

2026-06-06 22:31:09,250 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.

2026-06-06 22:31:09,251 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-06 22:31:09,843 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'

2026-06-06 22:31:11,067 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'

2026-06-06 22:31:11,271 - LinkedInScraper - INFO - New LinkedIn post: Full walk-through on Hermes agent desktop app 👇 - LinkedIn

2026-06-06 22:31:11,889 - LinkedInScraper - INFO - New LinkedIn post: OpenClaw vs. Hermes Agent Two open-source AI agents take opposite appr

2026-06-06 22:31:11,930 - LinkedInScraper - INFO - New LinkedIn post: By day, I design in-building networks. By night, I test tools that try

2026-06-06 22:31:12,523 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'

2026-06-06 22:31:12,553 - LinkedInScraper - INFO - New LinkedIn post: The Future of AI Development: From Tools to Teammates 🚀 We’ve all seen

2026-06-06 22:31:12,685 - LinkedInScraper - INFO - New LinkedIn post: Someone just created the open-source version of Claude Managed Agents

2026-06-06 22:31:13,233 - LinkedInScraper - INFO - New LinkedIn post: We still tend to think about infections as isolated clinical events. I

2026-06-06 22:31:13,273 - LinkedInScraper - INFO - New LinkedIn post: From Claude Code Orchestration Prototype to Deployed Agent: The Sideki

2026-06-06 22:31:13,274 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 7 new results.

2026-06-06 22:31:13,274 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-06-06 22:31:18,115 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-06 22:31:18,206 - GitHubScraper - INFO - Found 236 GitHub repositories for term: paperclip

2026-06-06 22:31:19,148 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-06 22:31:19,153 - GitHubScraper - INFO - Found 329 GitHub repositories for term: "Hermes Agent"

2026-06-06 22:31:20,160 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-06 22:31:20,163 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica

2026-06-06 22:31:20,302 - GitHubScraper - INFO - Total GitHub results found: 0

2026-06-06 22:31:20,302 - __main__ - INFO - Scraper reddit completed: 8 results

2026-06-06 22:31:20,302 - __main__ - INFO - Scraper github completed: 0 results

2026-06-06 22:31:20,302 - __main__ - INFO - Scraper twitter completed: 0 results

2026-06-06 22:31:20,302 - __main__ - INFO - Scraper linkedin completed: 7 results

2026-06-06 22:31:20,302 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-06-06 22:31:20,959 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-06 22:31:20.959576

2026-06-06 22:31:20,959 - __main__ - INFO - Email sent successfully

2026-06-06 22:31:20,960 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-06 22:31:20,960 - __main__ - INFO - Monitor complete. Found 15 total results: 8 new reddit results, 7 new linkedin results.

2026-06-06 22:31:20,960 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-06 22:31:20,960 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 22:31:21,062 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-06 22:31:21,063 - __main__ - INFO - Closed all database connections

2026-06-06 22:31:21,102 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 22:31:21,116 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-06 23:00:01,813 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-06.log

2026-06-06 23:00:01,813 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-06.log

2026-06-06 23:00:01,814 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-06.log

2026-06-06 23:00:01,814 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-06 23:00:01,852 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-06 23:00:01,852 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-06 23:00:01,854 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-06 23:00:01,855 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-06 23:00:01,896 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-06 23:00:01,896 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-06 23:00:01,955 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-06 23:00:01,956 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-06 23:00:01,957 - __main__ - INFO - RSS scraper initialized and enabled

2026-06-06 23:00:01,963 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled

2026-06-06 23:00:01,963 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0

2026-06-06 23:00:01,963 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-06-06 23:00:01,969 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-06 23:00:01,978 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled

2026-06-06 23:00:01,978 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3

2026-06-06 23:00:01,982 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-06 23:00:01,982 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0

2026-06-06 23:00:01,983 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-06 23:00:01,983 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-06-06 23:00:01,983 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-06 23:00:01,983 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-06-06 23:00:02,064 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-06-06 23:00:02,069 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters

2026-06-06 23:00:02,069 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-06-06 23:00:02,070 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-06-06 23:00:02,582 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-06-06 23:00:03,276 - RSSFeedScraper - INFO - Total RSS/HTML results: 3

2026-06-06 23:00:03,672 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-06-06 23:00:03,848 - Yiddish24Scraper - INFO - Received response with 452738 characters

2026-06-06 23:00:03,851 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (299562 chars)

2026-06-06 23:00:03,854 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-06-06 23:00:03,946 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-06-06 23:00:03,985 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-06-06 23:00:03,985 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-06-06 23:00:04,805 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-06-06 23:00:04,805 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-06-06 23:00:04,805 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-06-06 23:00:04,806 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-06-06 23:00:13,826 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-06-06 23:00:37,190 - IveltScraper - INFO - ivelt scrape complete. Checked 7 topics.

2026-06-06 23:00:37,190 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...

2026-06-06 23:00:38,017 - IveltScraper - INFO - Found 50 active topics on yidtish

2026-06-06 23:00:41,830 - IveltScraper - INFO - yidtish scrape complete. Checked 3 topics.

2026-06-06 23:00:41,830 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.

2026-06-06 23:00:41,831 - __main__ - INFO - Scraper rss completed: 3 results

2026-06-06 23:00:41,831 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-06-06 23:00:41,831 - __main__ - INFO - Scraper ivelt completed: 0 results

2026-06-06 23:00:42,401 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-06 23:00:42.401465

2026-06-06 23:00:42,401 - __main__ - INFO - Email sent successfully

2026-06-06 23:00:42,402 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-06 23:00:42,402 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.

2026-06-06 23:00:42,402 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-06 23:00:42,402 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 23:00:42,449 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-06 23:00:42,450 - __main__ - INFO - Closed all database connections

2026-06-06 23:00:42,452 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-06 23:00:42,452 - social_media_monitor.database.connection - INFO - Closed 0 database connections