โ Logs
social_media_monitor_2026-06-26.log
2026-06-26 20:00:01,877 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-26 20:00:01,878 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-26 20:00:01,881 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-26 20:00:01,881 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-26 20:00:01,881 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-26 20:00:01,887 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-26 20:00:01,896 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-26 20:00:01,897 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-26 20:00:01,901 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-26 20:00:01,901 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-26 20:00:01,902 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-26 20:00:01,902 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-26 20:00:01,902 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-26 20:00:01,902 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-26 20:00:02,006 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-26 20:00:02,011 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-26 20:00:02,011 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-26 20:00:02,014 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-26 20:00:02,481 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-26 20:00:03,038 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-26 20:00:14,302 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-26 20:00:17,495 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-26 20:00:24,121 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-26 20:00:24,356 - Yiddish24Scraper - INFO - Received response with 442131 characters
2026-06-26 20:00:24,359 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292455 chars)
2026-06-26 20:00:24,362 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-26 20:00:24,449 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-26 20:00:24,490 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-26 20:00:24,490 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-26 20:00:25,239 - Yiddish24Scraper - INFO - Page 1 summary: 7 new out of 100 total articles
2026-06-26 20:00:25,239 - Yiddish24Scraper - INFO - Page 1: 7/100 new items
2026-06-26 20:00:25,239 - Yiddish24Scraper - INFO - Low new item ratio (7.0%), stopping pagination
2026-06-26 20:00:25,240 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 7
2026-06-26 20:00:38,132 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-06-26 20:00:38,133 - IveltScraper - INFO - All forums scrape complete. Found 10 new posts.
2026-06-26 20:00:38,133 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-26 20:00:38,133 - __main__ - INFO - Scraper yiddish24 completed: 7 results
2026-06-26 20:00:38,133 - __main__ - INFO - Scraper ivelt completed: 10 results
2026-06-26 20:00:42,716 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-26 20:00:42.715977
2026-06-26 20:00:42,716 - __main__ - INFO - Email sent successfully
2026-06-26 20:00:42,716 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-26 20:00:42,716 - __main__ - INFO - Monitor complete. Found 20 total results: 3 new rss results, 7 new yiddish24 results, 10 new ivelt results.
2026-06-26 20:00:42,716 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-26 20:00:42,716 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 20:00:42,794 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-26 20:00:42,795 - __main__ - INFO - Closed all database connections
2026-06-26 20:00:42,797 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 20:00:42,797 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-26 20:30:02,475 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-26.log
2026-06-26 20:30:02,475 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-26.log
2026-06-26 20:30:02,475 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-26.log
2026-06-26 20:30:02,475 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-26 20:30:02,501 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-26 20:30:02,501 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-26 20:30:02,501 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-26 20:30:02,503 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-26 20:30:02,504 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-26 20:30:02,517 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-26 20:30:02,517 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-26 20:30:02,519 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-26 20:30:02,519 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-26 20:30:02,519 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-26 20:30:02,520 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-26 20:30:02,520 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-26 20:30:02,523 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-26 20:30:02,523 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-26 20:30:02,526 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-26 20:30:02,530 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-26 20:30:02,530 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-26 20:30:02,532 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-26 20:30:02,532 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-26 20:30:02,532 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-26 20:30:02,532 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-26 20:30:02,533 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-26 20:30:02,632 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-26 20:30:02,941 - LinkedInFeedScraper - INFO - Auto-grabbed fresh LinkedIn cookies from running Chrome (fallback).
2026-06-26 20:30:10,971 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-26 20:30:10,980 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Sol Jacobs - Job #2138: Watch Repair Technician | Brooklyn, NY
Our client is seeking a meticulous Watch Repair T
2026-06-26 20:30:11,000 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Hunter Pogatchnik - I just bought a property for $7,035 from a tax auction.
I should be able to sell it for $25,000-$3
2026-06-26 20:30:11,011 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Partners CRE - Commercial Real Estate - Congrats Shaya Braverman
2026-06-26 20:30:11,031 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Casey Babb - My dad died today. Thanks to The Free Press for letting me write this for him.
Dad โ I'll see you
2026-06-26 20:30:11,037 - LinkedInFeedScraper - INFO - New LinkedIn feed post: David Schwed - Not sure I'm allowed to post this on a Friday but I'm going to do it anyways.
I am working today ๐คซ๐คซ
2026-06-26 20:30:11,141 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 5 new posts.
2026-06-26 20:30:12,128 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-26 20:30:12,931 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 20:30:12,935 - GitHubScraper - INFO - Found 241 GitHub repositories for term: paperclip
2026-06-26 20:30:13,752 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-06-26 20:30:14,071 - GitHubScraper - INFO - GitHub feed: 148 fetched across pages, 0 new events for abeperl
2026-06-26 20:30:14,177 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 20:30:14,267 - GitHubScraper - INFO - Found 402 GitHub repositories for term: "Hermes Agent"
2026-06-26 20:30:18,942 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 20:30:19,029 - GitHubScraper - INFO - Found 53 GitHub repositories for term: multica
2026-06-26 20:30:19,176 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-26 20:30:19,176 - __main__ - INFO - Scraper github completed: 0 results
2026-06-26 20:30:19,176 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-06-26 20:30:19,176 - __main__ - INFO - Scraper linkedin_feed completed: 5 results
2026-06-26 20:30:19,177 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Checking 5 LinkedIn feed posts for webinar/course + Torah mentions...
2026-06-26 20:30:20,717 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 55 existing URLs from sheet for dedup
2026-06-26 20:30:21,780 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 40 existing links from Torah Matches sheet for dedup
2026-06-26 20:30:21,781 - social_media_monitor.sheets.webinar_sheets_writer - INFO - No webinar/course mentions found in LinkedIn feed posts
2026-06-26 20:30:21,782 - social_media_monitor.sheets.webinar_sheets_writer - INFO - No Torah/Talmud/Hasidic mentions found in LinkedIn feed posts
2026-06-26 20:30:24,943 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-26 20:30:24.943030
2026-06-26 20:30:24,943 - __main__ - INFO - Email sent successfully
2026-06-26 20:30:24,943 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-26 20:30:24,945 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new linkedin feed results.
2026-06-26 20:30:24,946 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-26 20:30:24,946 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 20:30:25,727 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-26 20:30:25,728 - __main__ - INFO - Closed all database connections
2026-06-26 20:30:25,729 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 20:30:25,729 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-26 21:00:02,308 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-26.log
2026-06-26 21:00:02,308 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-26.log
2026-06-26 21:00:02,308 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-26.log
2026-06-26 21:00:02,308 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-26 21:00:02,335 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-26 21:00:02,335 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-26 21:00:02,337 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-26 21:00:02,338 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-26 21:00:02,359 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-26 21:00:02,359 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-26 21:00:02,410 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-26 21:00:02,411 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-26 21:00:02,411 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-26 21:00:02,415 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-26 21:00:02,415 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-26 21:00:02,415 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-26 21:00:02,418 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-26 21:00:02,425 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-26 21:00:02,426 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-26 21:00:02,428 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-26 21:00:02,429 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-26 21:00:02,429 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-26 21:00:02,429 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-26 21:00:02,429 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-26 21:00:02,429 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-26 21:00:02,521 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-26 21:00:02,526 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-26 21:00:02,526 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-26 21:00:02,527 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-26 21:00:02,813 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-26 21:00:03,351 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-26 21:00:06,609 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-26 21:00:06,824 - Yiddish24Scraper - INFO - Received response with 428407 characters
2026-06-26 21:00:06,827 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (288136 chars)
2026-06-26 21:00:06,830 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-26 21:00:06,917 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-26 21:00:06,957 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-26 21:00:06,957 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-26 21:00:07,857 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles
2026-06-26 21:00:07,858 - Yiddish24Scraper - INFO - Page 1: 5/100 new items
2026-06-26 21:00:07,858 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination
2026-06-26 21:00:07,858 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5
2026-06-26 21:00:14,668 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-26 21:00:17,648 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-26 21:00:21,497 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-26 21:00:44,235 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-06-26 21:00:44,235 - IveltScraper - INFO - All forums scrape complete. Found 22 new posts.
2026-06-26 21:00:44,236 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-26 21:00:44,236 - __main__ - INFO - Scraper yiddish24 completed: 5 results
2026-06-26 21:00:44,236 - __main__ - INFO - Scraper ivelt completed: 22 results
2026-06-26 21:00:47,560 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-26 21:00:47.560357
2026-06-26 21:00:47,560 - __main__ - INFO - Email sent successfully
2026-06-26 21:00:47,561 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-26 21:00:47,561 - __main__ - INFO - Monitor complete. Found 30 total results: 3 new rss results, 5 new yiddish24 results, 22 new ivelt results.
2026-06-26 21:00:47,561 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-26 21:00:47,561 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 21:00:47,664 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-26 21:00:47,664 - __main__ - INFO - Closed all database connections
2026-06-26 21:00:47,666 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 21:00:47,666 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-26 21:30:02,153 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-26.log
2026-06-26 21:30:02,153 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-26.log
2026-06-26 21:30:02,153 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-26.log
2026-06-26 21:30:02,153 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-26 21:30:02,178 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-26 21:30:02,178 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-26 21:30:02,178 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-26 21:30:02,180 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-26 21:30:02,181 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-26 21:30:02,195 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-26 21:30:02,195 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-26 21:30:02,197 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-26 21:30:02,197 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-26 21:30:02,197 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-26 21:30:02,198 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-26 21:30:02,198 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-26 21:30:02,201 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-26 21:30:02,201 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-26 21:30:02,203 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-26 21:30:02,207 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-26 21:30:02,207 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-26 21:30:02,210 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-26 21:30:02,210 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-26 21:30:02,210 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-26 21:30:02,210 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-26 21:30:02,210 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-26 21:30:02,302 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-26 21:30:02,612 - LinkedInFeedScraper - INFO - Auto-grabbed fresh LinkedIn cookies from running Chrome (fallback).
2026-06-26 21:30:09,515 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-26 21:30:09,524 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yossi Wachtel - Last week, I accidentally let a fake version of me into thousands of inboxes.
(Not my finest moment
2026-06-26 21:30:09,539 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Adam Bry - We have a very talent-centric view of business, which is why we opened a Skydio R&D office in Zรผrich
2026-06-26 21:30:09,562 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Casey Babb - My dad died today. Thanks to The Free Press for letting me write this for him.
Dad โ I'll see you
2026-06-26 21:30:09,585 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yonah Stromer - A signed contract and a paystub are one thing, but a LinkedIn update makes it REAL.
Excited to anno
2026-06-26 21:30:09,662 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yosef Waxler, NCARB - One thing I didn't expect:
People don't struggle with zoning rules.
They struggle with connecting
2026-06-26 21:30:09,675 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 5 new posts.
2026-06-26 21:30:10,662 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-26 21:30:11,561 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 500 Internal Server Error"
2026-06-26 21:30:11,563 - GitHubScraper - ERROR - Error processing GitHub search for term 'paperclip': Server error '500 Internal Server Error' for url 'https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/500
2026-06-26 21:30:12,281 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-06-26 21:30:12,664 - GitHubScraper - INFO - GitHub feed: 148 fetched across pages, 0 new events for abeperl
2026-06-26 21:30:12,666 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 21:30:12,670 - GitHubScraper - INFO - Found 402 GitHub repositories for term: "Hermes Agent"
2026-06-26 21:30:13,709 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 21:30:13,713 - GitHubScraper - INFO - Found 53 GitHub repositories for term: multica
2026-06-26 21:30:13,852 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-26 21:30:13,852 - __main__ - INFO - Scraper github completed: 0 results
2026-06-26 21:30:13,852 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-06-26 21:30:13,852 - __main__ - INFO - Scraper linkedin_feed completed: 5 results
2026-06-26 21:30:13,853 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Checking 5 LinkedIn feed posts for webinar/course + Torah mentions...
2026-06-26 21:30:15,208 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 55 existing URLs from sheet for dedup
2026-06-26 21:30:15,625 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 40 existing links from Torah Matches sheet for dedup
2026-06-26 21:30:15,626 - social_media_monitor.sheets.webinar_sheets_writer - INFO - No webinar/course mentions found in LinkedIn feed posts
2026-06-26 21:30:15,626 - social_media_monitor.sheets.webinar_sheets_writer - INFO - No Torah/Talmud/Hasidic mentions found in LinkedIn feed posts
2026-06-26 21:30:17,614 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-26 21:30:17.614339
2026-06-26 21:30:17,614 - __main__ - INFO - Email sent successfully
2026-06-26 21:30:17,615 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-26 21:30:17,615 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new linkedin feed results.
2026-06-26 21:30:17,615 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-26 21:30:17,615 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 21:30:17,683 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-26 21:30:17,683 - __main__ - INFO - Closed all database connections
2026-06-26 21:30:17,685 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 21:30:17,685 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-26 22:00:02,195 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-26.log
2026-06-26 22:00:02,195 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-26.log
2026-06-26 22:00:02,195 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-26.log
2026-06-26 22:00:02,196 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-26 22:00:02,221 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-26 22:00:02,221 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-26 22:00:02,223 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-26 22:00:02,224 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-26 22:00:02,239 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-26 22:00:02,239 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-26 22:00:02,241 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-26 22:00:02,242 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-26 22:00:02,242 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-26 22:00:02,244 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-26 22:00:02,244 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-26 22:00:02,245 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-26 22:00:02,247 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-26 22:00:02,252 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-26 22:00:02,252 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-26 22:00:02,254 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-26 22:00:02,254 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-26 22:00:02,254 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-26 22:00:02,254 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-26 22:00:02,254 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-26 22:00:02,254 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-26 22:00:02,341 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-26 22:00:02,346 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-26 22:00:02,346 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-26 22:00:02,348 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-26 22:00:02,598 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-26 22:00:03,972 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-26 22:00:07,316 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-26 22:00:07,525 - Yiddish24Scraper - INFO - Received response with 433829 characters
2026-06-26 22:00:07,528 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (293320 chars)
2026-06-26 22:00:07,531 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-26 22:00:07,622 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-26 22:00:07,665 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-26 22:00:07,665 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-26 22:00:08,416 - Yiddish24Scraper - INFO - Page 1 summary: 8 new out of 100 total articles
2026-06-26 22:00:08,416 - Yiddish24Scraper - INFO - Page 1: 8/100 new items
2026-06-26 22:00:08,416 - Yiddish24Scraper - INFO - Low new item ratio (8.0%), stopping pagination
2026-06-26 22:00:08,417 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 8
2026-06-26 22:00:14,319 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-26 22:00:20,602 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-26 22:00:38,275 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-06-26 22:00:38,275 - IveltScraper - INFO - All forums scrape complete. Found 9 new posts.
2026-06-26 22:00:38,276 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-26 22:00:38,276 - __main__ - INFO - Scraper yiddish24 completed: 8 results
2026-06-26 22:00:38,277 - __main__ - INFO - Scraper ivelt completed: 9 results
2026-06-26 22:00:39,431 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-26 22:00:39.431394
2026-06-26 22:00:39,431 - __main__ - INFO - Email sent successfully
2026-06-26 22:00:39,432 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-26 22:00:39,432 - __main__ - INFO - Monitor complete. Found 20 total results: 3 new rss results, 8 new yiddish24 results, 9 new ivelt results.
2026-06-26 22:00:39,432 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-26 22:00:39,432 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 22:00:39,563 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-26 22:00:39,563 - __main__ - INFO - Closed all database connections
2026-06-26 22:00:39,565 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 22:00:39,565 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-26 22:30:02,079 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-26.log
2026-06-26 22:30:02,079 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-26.log
2026-06-26 22:30:02,080 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-26.log
2026-06-26 22:30:02,080 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-26 22:30:02,106 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-26 22:30:02,106 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-26 22:30:02,106 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-26 22:30:02,108 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-26 22:30:02,109 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-26 22:30:02,140 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-26 22:30:02,140 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-26 22:30:02,188 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-26 22:30:02,188 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-26 22:30:02,188 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-26 22:30:02,189 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-26 22:30:02,189 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-26 22:30:02,192 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-26 22:30:02,192 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-26 22:30:02,195 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-26 22:30:02,199 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-26 22:30:02,199 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-26 22:30:02,201 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-26 22:30:02,201 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-26 22:30:02,201 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-26 22:30:02,201 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-26 22:30:02,202 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-26 22:30:02,295 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-26 22:30:02,641 - LinkedInFeedScraper - INFO - Auto-grabbed fresh LinkedIn cookies from running Chrome (fallback).
2026-06-26 22:30:10,543 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-26 22:30:10,552 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Carter Colton - I am about to go to bed...it's 10:30 in Venice.
So I figured I would just light a fire and run.
B
2026-06-26 22:30:10,587 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yosel Tiefenbrun - This week I got a year older...
most of it spent at the fitting table...grateful for every minute!
2026-06-26 22:30:10,640 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Bill Banfield - I lost sleep when we launched this product.
There was virtually no secondary market at the time an
2026-06-26 22:30:10,674 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Bilotta Kitchens - The mood of a space begins long before the cabinetry is installed.โ
Soft linen, honed stone, brushed
2026-06-26 22:30:10,685 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 4 new posts.
2026-06-26 22:30:11,644 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-26 22:30:12,357 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 22:30:12,361 - GitHubScraper - INFO - Found 241 GitHub repositories for term: paperclip
2026-06-26 22:30:13,022 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-06-26 22:30:13,343 - GitHubScraper - INFO - GitHub feed: 147 fetched across pages, 0 new events for abeperl
2026-06-26 22:30:13,553 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 22:30:13,644 - GitHubScraper - INFO - Found 404 GitHub repositories for term: "Hermes Agent"
2026-06-26 22:30:13,709 - GitHubScraper - INFO - Added new GitHub repository: omnigent
2026-06-26 22:30:14,571 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 22:30:14,660 - GitHubScraper - INFO - Found 53 GitHub repositories for term: multica
2026-06-26 22:30:14,807 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-26 22:30:14,807 - __main__ - INFO - Scraper github completed: 1 results
2026-06-26 22:30:14,807 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-06-26 22:30:14,807 - __main__ - INFO - Scraper linkedin_feed completed: 4 results
2026-06-26 22:30:14,807 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Checking 4 LinkedIn feed posts for webinar/course + Torah mentions...
2026-06-26 22:30:16,570 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 55 existing URLs from sheet for dedup
2026-06-26 22:30:17,532 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 40 existing links from Torah Matches sheet for dedup
2026-06-26 22:30:17,532 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Torah match: Yosel Tiefenbrun - keyword 'shabbat' - https://www.linkedin.com/feed/update/urn:li:activity:7476400282726281216
2026-06-26 22:30:17,532 - social_media_monitor.sheets.webinar_sheets_writer - INFO - No webinar/course mentions found in LinkedIn feed posts
2026-06-26 22:30:17,999 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Appended 1 rows to Google Sheet 'Torah Matches'
2026-06-26 22:30:17,999 - __main__ - INFO - Webinar/Course: appended 1 posts to Google Sheet
2026-06-26 22:30:18,747 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-26 22:30:18.747111
2026-06-26 22:30:18,747 - __main__ - INFO - Email sent successfully
2026-06-26 22:30:18,748 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-26 22:30:18,748 - __main__ - INFO - Monitor complete. Found 5 total results: 1 new github results, 4 new linkedin feed results.
2026-06-26 22:30:18,748 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-26 22:30:18,748 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 22:30:18,821 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-26 22:30:18,822 - __main__ - INFO - Closed all database connections
2026-06-26 22:30:18,824 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 22:30:18,824 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-26 23:00:02,425 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-26.log
2026-06-26 23:00:02,425 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-26.log
2026-06-26 23:00:02,425 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-26.log
2026-06-26 23:00:02,425 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-26 23:00:02,450 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-26 23:00:02,451 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-26 23:00:02,453 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-26 23:00:02,453 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-26 23:00:02,473 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-26 23:00:02,473 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-26 23:00:02,476 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-26 23:00:02,477 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-26 23:00:02,477 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-26 23:00:02,479 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-26 23:00:02,479 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-26 23:00:02,479 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-26 23:00:02,482 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-26 23:00:02,487 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-26 23:00:02,487 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-26 23:00:02,490 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-26 23:00:02,490 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-26 23:00:02,490 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-26 23:00:02,490 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-26 23:00:02,490 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-26 23:00:02,490 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-26 23:00:02,578 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-26 23:00:02,582 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-26 23:00:02,582 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-26 23:00:02,584 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-26 23:00:02,875 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-26 23:00:03,277 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-26 23:00:03,639 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-26 23:00:03,840 - Yiddish24Scraper - INFO - Received response with 433829 characters
2026-06-26 23:00:03,843 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (293320 chars)
2026-06-26 23:00:03,846 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-26 23:00:03,940 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-26 23:00:03,979 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-26 23:00:03,980 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-26 23:00:04,829 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-06-26 23:00:04,829 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-06-26 23:00:04,829 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-06-26 23:00:04,830 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-06-26 23:00:14,754 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-26 23:00:17,665 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-26 23:00:29,112 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-06-26 23:00:29,113 - IveltScraper - INFO - All forums scrape complete. Found 2 new posts.
2026-06-26 23:00:29,113 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-26 23:00:29,113 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-06-26 23:00:29,113 - __main__ - INFO - Scraper ivelt completed: 2 results
2026-06-26 23:00:30,034 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-26 23:00:30.034849
2026-06-26 23:00:30,035 - __main__ - INFO - Email sent successfully
2026-06-26 23:00:30,035 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-26 23:00:30,035 - __main__ - INFO - Monitor complete. Found 5 total results: 3 new rss results, 2 new ivelt results.
2026-06-26 23:00:30,035 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-26 23:00:30,035 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 23:00:30,143 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-26 23:00:30,144 - __main__ - INFO - Closed all database connections
2026-06-26 23:00:30,145 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 23:00:30,146 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-26 23:30:02,616 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-26.log
2026-06-26 23:30:02,617 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-26.log
2026-06-26 23:30:02,617 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-26.log
2026-06-26 23:30:02,617 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-26 23:30:02,643 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-26 23:30:02,643 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-26 23:30:02,643 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-26 23:30:02,645 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-26 23:30:02,646 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-26 23:30:02,679 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-26 23:30:02,679 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-26 23:30:02,727 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-26 23:30:02,727 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-26 23:30:02,727 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-26 23:30:02,728 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-26 23:30:02,728 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-26 23:30:02,732 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-26 23:30:02,732 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-26 23:30:02,734 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-26 23:30:02,739 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-26 23:30:02,739 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-26 23:30:02,741 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-26 23:30:02,741 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-26 23:30:02,741 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-26 23:30:02,741 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-26 23:30:02,741 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-26 23:30:02,833 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-26 23:30:03,154 - LinkedInFeedScraper - INFO - Auto-grabbed fresh LinkedIn cookies from running Chrome (fallback).
2026-06-26 23:30:13,836 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-26 23:30:14,036 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 0 new posts.
2026-06-26 23:30:14,912 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-26 23:30:15,628 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 23:30:15,632 - GitHubScraper - INFO - Found 241 GitHub repositories for term: paperclip
2026-06-26 23:30:16,277 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-06-26 23:30:16,577 - GitHubScraper - INFO - GitHub feed: 147 fetched across pages, 0 new events for abeperl
2026-06-26 23:30:16,773 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 23:30:16,777 - GitHubScraper - INFO - Found 405 GitHub repositories for term: "Hermes Agent"
2026-06-26 23:30:16,800 - GitHubScraper - INFO - Added new GitHub repository: obsidian-second-brain
2026-06-26 23:30:17,718 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-26 23:30:17,722 - GitHubScraper - INFO - Found 53 GitHub repositories for term: multica
2026-06-26 23:30:17,872 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-26 23:30:17,872 - __main__ - INFO - Scraper github completed: 1 results
2026-06-26 23:30:17,872 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-06-26 23:30:17,872 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-26 23:30:17,873 - __main__ - WARNING - LinkedIn Feed: 1 consecutive failures (0 results)
2026-06-26 23:30:18,572 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-26 23:30:18.572603
2026-06-26 23:30:18,572 - __main__ - INFO - Email sent successfully
2026-06-26 23:30:18,573 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-26 23:30:18,573 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new github results.
2026-06-26 23:30:18,573 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-26 23:30:18,573 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 23:30:18,619 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-26 23:30:18,619 - __main__ - INFO - Closed all database connections
2026-06-26 23:30:18,621 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-26 23:30:18,621 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...