← Logs

social_media_monitor_2026-06-30.log

2026-06-30 11:00:01,714 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-30.log

2026-06-30 11:00:01,714 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-30 11:00:01,739 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-30 11:00:01,742 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-30 11:00:01,744 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-30 11:00:01,744 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-30 11:00:01,763 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-30 11:00:01,763 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-30 11:00:01,765 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-30 11:00:01,766 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-30 11:00:01,766 - __main__ - INFO - RSS scraper initialized and enabled

2026-06-30 11:00:01,769 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-06-30 11:00:01,769 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-06-30 11:00:01,769 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-06-30 11:00:01,771 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-30 11:00:01,777 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-06-30 11:00:01,777 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10

2026-06-30 11:00:01,779 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-30 11:00:01,779 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1

2026-06-30 11:00:01,779 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-30 11:00:01,779 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-06-30 11:00:01,779 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-30 11:00:01,779 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-06-30 11:00:01,869 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-06-30 11:00:01,874 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters

2026-06-30 11:00:01,874 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-06-30 11:00:01,876 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-06-30 11:00:02,130 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-06-30 11:00:02,588 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-06-30 11:00:02,982 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-06-30 11:00:03,213 - Yiddish24Scraper - INFO - Received response with 477028 characters

2026-06-30 11:00:03,214 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (303406 chars)

2026-06-30 11:00:03,216 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-06-30 11:00:03,291 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-06-30 11:00:03,355 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements

2026-06-30 11:00:03,355 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1

2026-06-30 11:00:04,106 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles

2026-06-30 11:00:04,107 - Yiddish24Scraper - INFO - Page 1: 0/99 new items

2026-06-30 11:00:04,107 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-06-30 11:00:04,107 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-06-30 11:00:13,542 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-06-30 11:00:28,295 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.

2026-06-30 11:00:28,295 - IveltScraper - INFO - All forums scrape complete. Found 1 new posts.

2026-06-30 11:00:28,295 - __main__ - INFO - Scraper rss completed: 0 results

2026-06-30 11:00:28,295 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-06-30 11:00:28,295 - __main__ - INFO - Scraper ivelt completed: 1 results

2026-06-30 11:00:29,076 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-30 11:00:29.076309

2026-06-30 11:00:29,076 - __main__ - INFO - Email sent successfully

2026-06-30 11:00:29,076 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-30 11:00:29,077 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new ivelt results.

2026-06-30 11:00:29,077 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-30 11:00:29,077 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 11:00:29,141 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-30 11:00:29,141 - __main__ - INFO - Closed all database connections

2026-06-30 11:00:29,143 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 11:00:29,143 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-30 11:30:01,728 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-30.log

2026-06-30 11:30:01,728 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-30.log

2026-06-30 11:30:01,729 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-30.log

2026-06-30 11:30:01,729 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-30 11:30:01,753 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-30 11:30:01,754 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-30 11:30:01,756 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-30 11:30:01,756 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-30 11:30:01,779 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-30 11:30:01,779 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-30 11:30:01,781 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-30 11:30:01,782 - __main__ - INFO - GitHub scraper initialized and enabled

2026-06-30 11:30:01,782 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-06-30 11:30:01,782 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-30 11:30:01,783 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-06-30 11:30:01,785 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-06-30 11:30:01,785 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-06-30 11:30:01,788 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-30 11:30:01,792 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-06-30 11:30:01,793 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10

2026-06-30 11:30:01,795 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-30 11:30:01,795 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1

2026-06-30 11:30:01,796 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-30 11:30:01,796 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-30 11:30:01,796 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-30 11:30:01,893 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-06-30 11:31:02,065 - LinkedInFeedScraper - ERROR - LinkedIn cookie auto-grab from Chrome (port 9224) failed: Message: session not created: cannot connect to chrome at 127.0.0.1:9224

from chrome not reachable; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception

Stacktrace:

#0 0x62ed9e8703da <unknown>

#1 0x62ed9e251ef0 <unknown>

#2 0x62ed9e23d76c <unknown>

#3 0x62ed9e295b3e <unknown>

#4 0x62ed9e28aca1 <unknown>

#5 0x62ed9e2dad96 <unknown>

#6 0x62ed9e2da47c <unknown>

#7 0x62ed9e299e4f <unknown>

#8 0x62ed9e29ac31 <unknown>

#9 0x62ed9e8369f7 <unknown>

#10 0x62ed9e835203 <unknown>

#11 0x62ed9e81ff16 <unknown>

#12 0x62ed9e835d9a <unknown>

#13 0x62ed9e807eb0 <unknown>

#14 0x62ed9e85cd58 <unknown>

#15 0x62ed9e85cef5 <unknown>

#16 0x62ed9e86ef5e <unknown>

#17 0x7c855589caa4 <unknown>

#18 0x7c8555929c6c <unknown>

2026-06-30 11:31:02,066 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)

2026-06-30 11:31:02,074 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 0 new posts.

2026-06-30 11:31:02,649 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-06-30 11:31:03,315 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-30 11:31:03,317 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip

2026-06-30 11:31:04,223 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-06-30 11:31:04,955 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-30 11:31:04,959 - GitHubScraper - INFO - Found 408 GitHub repositories for term: "Hermes Agent"

2026-06-30 11:31:04,993 - GitHubScraper - INFO - Added new GitHub repository: mnemosyne

2026-06-30 11:31:06,121 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-30 11:31:06,123 - GitHubScraper - INFO - Found 55 GitHub repositories for term: multica

2026-06-30 11:31:06,263 - GitHubScraper - INFO - Total GitHub results found: 1

2026-06-30 11:31:06,282 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"

2026-06-30 11:31:06,656 - GitHubScraper - INFO - GitHub feed: 256 fetched across pages, 0 new events for abeperl

2026-06-30 11:31:06,657 - __main__ - INFO - Scraper github completed: 1 results

2026-06-30 11:31:06,657 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-06-30 11:31:06,657 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-06-30 11:31:06,658 - __main__ - WARNING - LinkedIn Feed: 14 consecutive failures (0 results)

2026-06-30 11:31:07,483 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-30 11:31:07.482953

2026-06-30 11:31:07,483 - __main__ - INFO - Email sent successfully

2026-06-30 11:31:07,483 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-30 11:31:07,483 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new github results.

2026-06-30 11:31:07,483 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-30 11:31:07,483 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 11:31:07,555 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-30 11:31:07,556 - __main__ - INFO - Closed all database connections

2026-06-30 11:31:07,558 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 11:31:07,558 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-30 12:00:02,100 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-30.log

2026-06-30 12:00:02,100 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-30.log

2026-06-30 12:00:02,100 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-30.log

2026-06-30 12:00:02,100 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-30 12:00:02,126 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-30 12:00:02,126 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-30 12:00:02,129 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-30 12:00:02,140 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-30 12:00:02,149 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-30 12:00:02,150 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-30 12:00:02,198 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-30 12:00:02,199 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-30 12:00:02,199 - __main__ - INFO - RSS scraper initialized and enabled

2026-06-30 12:00:02,202 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-06-30 12:00:02,203 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-06-30 12:00:02,203 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-06-30 12:00:02,205 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-30 12:00:02,210 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-06-30 12:00:02,210 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10

2026-06-30 12:00:02,213 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-30 12:00:02,213 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1

2026-06-30 12:00:02,214 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-30 12:00:02,214 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-06-30 12:00:02,214 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-30 12:00:02,214 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-06-30 12:00:02,325 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-06-30 12:00:02,330 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters

2026-06-30 12:00:02,330 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-06-30 12:00:02,332 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-06-30 12:00:02,553 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-06-30 12:00:02,950 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-06-30 12:00:03,323 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-06-30 12:00:03,552 - Yiddish24Scraper - INFO - Received response with 477028 characters

2026-06-30 12:00:03,553 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (303406 chars)

2026-06-30 12:00:03,554 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-06-30 12:00:03,656 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-06-30 12:00:03,698 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements

2026-06-30 12:00:03,698 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1

2026-06-30 12:00:04,314 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles

2026-06-30 12:00:04,315 - Yiddish24Scraper - INFO - Page 1: 0/99 new items

2026-06-30 12:00:04,315 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-06-30 12:00:04,315 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-06-30 12:00:14,606 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-06-30 12:00:17,706 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-06-30 12:00:39,174 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.

2026-06-30 12:00:39,174 - IveltScraper - INFO - All forums scrape complete. Found 8 new posts.

2026-06-30 12:00:39,175 - __main__ - INFO - Scraper rss completed: 0 results

2026-06-30 12:00:39,175 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-06-30 12:00:39,175 - __main__ - INFO - Scraper ivelt completed: 8 results

2026-06-30 12:00:41,890 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-30 12:00:41.890139

2026-06-30 12:00:41,890 - __main__ - INFO - Email sent successfully

2026-06-30 12:00:41,891 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-30 12:00:41,891 - __main__ - INFO - Monitor complete. Found 8 total results: 8 new ivelt results.

2026-06-30 12:00:41,891 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-30 12:00:41,891 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 12:00:41,920 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-30 12:00:41,920 - __main__ - INFO - Closed all database connections

2026-06-30 12:00:41,922 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 12:00:41,922 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-30 12:15:01,943 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-30.log

2026-06-30 12:15:01,943 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-30.log

2026-06-30 12:15:01,943 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-30.log

2026-06-30 12:15:01,943 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-30 12:15:01,969 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-30 12:15:01,969 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-30 12:15:01,971 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-30 12:15:01,971 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-30 12:15:01,984 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-30 12:15:01,985 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-30 12:15:01,987 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-30 12:15:01,988 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-30 12:15:01,990 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-06-30 12:15:01,990 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-06-30 12:15:01,993 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-30 12:15:01,995 - __main__ - INFO - Gmail Downloads scraper initialized and enabled

2026-06-30 12:15:01,997 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-06-30 12:15:01,997 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10

2026-06-30 12:15:01,997 - __main__ - INFO - TorahAnytime scraper initialized and enabled

2026-06-30 12:15:01,999 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-30 12:15:02,000 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1

2026-06-30 12:15:02,000 - __main__ - INFO - Batorah scraper initialized and enabled

2026-06-30 12:15:02,000 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-30 12:15:02,000 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-30 12:15:02,001 - TorahAnytimeScraper - INFO - Starting TorahAnytime scraping (limit 400, max 100 items)

2026-06-30 12:15:02,089 - BatorahScraper - INFO - Starting Batorah scraping (2 APIs, page_size=100, max 100 items)

2026-06-30 12:15:02,094 - BatorahScraper - INFO - Fetching from: https://batorah.com/api/yi/latest-videos-three

2026-06-30 12:15:02,196 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully connected to Gmail IMAP: abeperl@gmail.com

2026-06-30 12:15:02,250 - social_media_monitor.scrapers.gmail_scraper - INFO - Found 18 emails with label: Z0TorahLinks

2026-06-30 12:15:02,786 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: AP Torah - 2026-06-30 06:15 (2026-06-29) from abeperl@gmail.com

2026-06-30 12:15:02,834 - social_media_monitor.utils.link_extractor - INFO - Extracted 30 links with context from email

2026-06-30 12:15:03,173 - httpx - INFO - HTTP Request: GET https://batorah.com/api/yi/latest-videos-three?pagesize=100&pageno=1&time=1782821702094&followerId= "HTTP/1.1 200 OK"

2026-06-30 12:15:03,505 - BatorahScraper - INFO - Fetched 100 videos from https://batorah.com/api/yi/latest-videos-three

2026-06-30 12:15:03,509 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://batorah.com/yi/video/63606

2026-06-30 12:15:03,515 - BatorahScraper - INFO - NEW video (no filter match, notifying only): מסירות נפש על חינוך הבנים מעוררת זכות לדורות... (id=63609)

2026-06-30 12:15:04,088 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://batorah.com/yi/video/63604

2026-06-30 12:15:04,408 - BatorahScraper - INFO - Fetching from: https://batorah.com/api/yi/category-home-slider-one

2026-06-30 12:15:04,411 - httpx - INFO - HTTP Request: GET https://api.torahanytime.com/lectures/latest-list?limit=400&offset=0&project_id=1 "HTTP/1.1 200 OK"

2026-06-30 12:15:04,452 - TorahAnytimeScraper - INFO - Fetched 401 lectures from API

2026-06-30 12:15:04,595 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://batorah.com/yi/video/63603

2026-06-30 12:15:05,096 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://batorah.com/yi/video/63602

2026-06-30 12:15:05,592 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://batorah.com/yi/video/63601

2026-06-30 12:15:06,580 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459636

2026-06-30 12:15:07,474 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459637

2026-06-30 12:15:07,655 - TorahAnytimeScraper - INFO - Total TorahAnytime results found: 26

2026-06-30 12:15:07,657 - httpx - INFO - HTTP Request: GET https://batorah.com/api/yi/category-home-slider-one?no "HTTP/1.1 200 OK"

2026-06-30 12:15:07,658 - BatorahScraper - INFO - Fetched 10 videos from https://batorah.com/api/yi/category-home-slider-one

2026-06-30 12:15:07,658 - BatorahScraper - INFO - Total Batorah results found: 1

2026-06-30 12:15:08,277 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/458051

2026-06-30 12:15:09,122 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459632

2026-06-30 12:15:09,939 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459629

2026-06-30 12:15:10,809 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459246

2026-06-30 12:15:11,638 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459633

2026-06-30 12:15:12,454 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459624

2026-06-30 12:15:13,274 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459622

2026-06-30 12:15:14,104 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459625

2026-06-30 12:15:14,935 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459333

2026-06-30 12:15:15,767 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459612

2026-06-30 12:15:16,595 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459617

2026-06-30 12:15:17,457 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459611

2026-06-30 12:15:18,391 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459609

2026-06-30 12:15:19,305 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459610

2026-06-30 12:15:20,151 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459607

2026-06-30 12:15:20,971 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459608

2026-06-30 12:15:21,779 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459602

2026-06-30 12:15:22,620 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459601

2026-06-30 12:15:23,426 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459600

2026-06-30 12:15:24,240 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://torahanytime.com/lectures/459597

2026-06-30 12:15:24,250 - social_media_monitor.scrapers.gmail_scraper - INFO - URL already downloaded, skipping: https://ymlpcdn7.net/64a8eesqbmavaeqjsbafamjuaiaumjqj/click.php

2026-06-30 12:15:24,257 - social_media_monitor.scrapers.gmail_scraper - INFO - URL already downloaded, skipping: https://ymlpcdn7.net/01bb9esqhsaxaeqjsbacamjuaoaumjqj/click.php

2026-06-30 12:15:24,265 - social_media_monitor.scrapers.gmail_scraper - INFO - URL already downloaded, skipping: https://ymlpcdn7.net/654d5esqhuafaeqjsbalamjuataumjqj/click.php

2026-06-30 12:15:24,277 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: AP Torah - 2026-06-30 06:15

2026-06-30 12:15:24,655 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 14

2026-06-30 12:15:24,685 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 14

2026-06-30 12:15:24,685 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: AP Torah - 2026-06-30 06:15

2026-06-30 12:15:25,063 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: אויף וועלכן פלאץ עס גייט אן דער איסור (2026-06-30) from דעהו | הלכה יומית <info@doeihu.org>

2026-06-30 12:15:25,075 - social_media_monitor.utils.link_extractor - INFO - Extracted 5 links with context from email

2026-06-30 12:15:26,575 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://mailchi.mp/doeihu/jak9iojzb5-13903984-7x6i751cza-13904041-zrdmhpfv0z-13904563?e=bf2052ac28

2026-06-30 12:15:27,671 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/hfsOsOD0j4X?e=bf2052ac28&c2id=7659f9bb7d531bd197b73e8672da6fb1

2026-06-30 12:15:28,606 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/lug1SosIqrn?e=bf2052ac28&c2id=7659f9bb7d531bd197b73e8672da6fb1

2026-06-30 12:15:29,499 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/x0dZD4i6u1P?e=bf2052ac28&c2id=7659f9bb7d531bd197b73e8672da6fb1

2026-06-30 12:15:33,325 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/BWJpEDh0Eef?e=bf2052ac28&c2id=7659f9bb7d531bd197b73e8672da6fb1

2026-06-30 12:15:33,343 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: אויף וועלכן פלאץ עס גייט אן דער איסור

2026-06-30 12:15:33,716 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 15

2026-06-30 12:15:33,748 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 15

2026-06-30 12:15:33,748 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: אויף וועלכן פלאץ עס גייט אן דער איסור

2026-06-30 12:15:34,679 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: שיעור מקול הלשון (2026-06-30) from שרת המייל של קול הלשון <mp3@kolhl.com>

2026-06-30 12:15:34,857 - social_media_monitor.scrapers.gmail_scraper - INFO - Routing audio file (audio/mpeg) to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-30 12:15:34,864 - social_media_monitor.scrapers.gmail_scraper - INFO - Routing audio file (audio/mpeg) to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio

2026-06-30 12:15:34,868 - social_media_monitor.utils.media_tagger - INFO - Tagged GM_2026-06-30_42631585_שפיצר, הרב שמעון.mp3: title, artist, album, date, comment, genre, publisher

2026-06-30 12:15:34,868 - social_media_monitor.scrapers.gmail_scraper - INFO - Applied media tags to attachment: GM_2026-06-30_42631585_שפיצר, הרב שמעון.mp3

2026-06-30 12:15:34,884 - social_media_monitor.scrapers.gmail_scraper - INFO - Email has attachments, skipping link extraction for: שיעור מקול הלשון

2026-06-30 12:15:34,894 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: שיעור מקול הלשון

2026-06-30 12:15:35,284 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 16

2026-06-30 12:15:35,320 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 16

2026-06-30 12:15:35,320 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: שיעור מקול הלשון

2026-06-30 12:15:35,718 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: זכרו טעגליכע שיעורים | יום ג' פרשת פנחס תשפ"ו (2026-06-30) from חבורת זכרו <torahline@hasatmar.org>

2026-06-30 12:15:35,763 - social_media_monitor.utils.link_extractor - INFO - Extracted 18 links with context from email

2026-06-30 12:15:37,646 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/_aVhOCztLT8?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:38,503 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/cNvTN75zHvK?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:39,650 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/IW79CQj5PI3?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:40,538 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/luYPkjX2iSr?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:41,496 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/qnRMnECzF1K?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:42,394 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/BDP9Ne4kFPd?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:43,065 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/14Dbs3xN2Qs?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:43,650 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/bcjECtTbm8b?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:44,549 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/U_QuXasgdzp?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:45,482 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/R_8dRRqck3I?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:46,324 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/UWV82jXclML?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:47,310 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/jZPINW9YZCe?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:48,273 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/4Uv3UAwG06N?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:49,491 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/d1bY0e6TB3l?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:50,022 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/_IrWD7aroIS?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:15:50,852 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/pk3ZjuxO1V1?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:16:01,398 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://us.list-manage.com/W0FM8cwf3vL?e=9a66050bd4&c2id=adbf34ffbf0d0a151343a75c946cffd5

2026-06-30 12:16:02,127 - social_media_monitor.utils.file_downloader - INFO - Skipping blocked tracking domain: https://gmail.us22.list-manage.com/about?u=bf2396a201d0fe891b67ddb7b&id=f7741f74bc&e=9a66050bd4&c=a3fbec1073

2026-06-30 12:16:02,139 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: זכרו טעגליכע שיעורים | יום ג' פרשת פנחס תשפ"ו

2026-06-30 12:16:02,526 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 17

2026-06-30 12:16:02,554 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 17

2026-06-30 12:16:02,554 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: זכרו טעגליכע שיעורים | יום ג' פרשת פנחס תשפ"ו

2026-06-30 12:16:02,942 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: דינסטאג פרשת פינחס • ט"ו תמוז תשפ"ו | בחצרות הקודש (2026-06-30) from בחצרות הקודש <subscribe@bechatzros.com>

2026-06-30 12:16:02,997 - social_media_monitor.utils.link_extractor - INFO - Extracted 29 links with context from email

2026-06-30 12:16:04,590 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://bechatzros.com/so/02PyMbcD4?languageTag=he&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:09,185 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:10,617 - social_media_monitor.utils.file_downloader - INFO - Skipping URL - final URL after redirect matches ignore terms: https://donary.com/3354

2026-06-30 12:16:11,809 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/9975000?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:12,856 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/9855400?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:13,832 - social_media_monitor.utils.file_downloader - INFO - Skipping URL - final URL after redirect matches ignore terms: https://donary.com/bb6692cb00e1

2026-06-30 12:16:17,339 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/9875548?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:18,789 - social_media_monitor.utils.file_downloader - INFO - Converted Google Drive URL to direct download: https://drive.google.com/file/d/1TZ1e1kRpk9Tt6c0eEd4K5d8kjL4mLOmI/view -> https://drive.google.com/uc?export=download&id=1TZ1e1kRpk9Tt6c0eEd4K5d8kjL4mLOmI

2026-06-30 12:16:21,075 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://bechatzros.com/so/02PyMbcD4/c?w=sbazyGu47Qc9yBd4r0x_WBsU2QNZJv18GVUKOegdUt0.eyJ1IjoiaHR0cHM6Ly9kcml2ZS5nb29nbGUuY29tL2ZpbGUvZC8xVFoxZTFrUnBrOVR0NmMwZUVkNEs1ZDhrakw0bUxPbUkvdmlldyIsInIiOiJhNTQ4YmQzMi1kODZhLTQzZTgtYWQzZS1mMzZiZDBmYmVjM2YiLCJtIjoibWFpbCIsImMiOiJlNmYxNDNhNS05MzQ4LTRmZjQtOTAyNi03NDljOTVkMWQ3MzUifQ to https://drive.usercontent.google.com/download?id=1TZ1e1kRpk9Tt6c0eEd4K5d8kjL4mLOmI&export=download

2026-06-30 12:16:21,075 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://drive.usercontent.google.com/download?id=1TZ1e1kRpk9Tt6c0eEd4K5d8kjL4mLOmI&export=download

2026-06-30 12:16:23,375 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_AI - Steinmetz Brochure.pdf (5.2 MB)

2026-06-30 12:16:23,375 - social_media_monitor.scrapers.gmail_scraper - INFO - Skipping PDF file from link: GM_AI - Steinmetz Brochure.pdf

2026-06-30 12:16:28,150 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/997878?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:28,965 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/698742154?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:29,713 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/98751454?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:34,156 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/6987448?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:37,966 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/9854222?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:38,702 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/9878558?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:42,006 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/6980011?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:42,941 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/998000121?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:43,840 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/69221000?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:47,236 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/post/7032748?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:49,769 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/%D7%9E%D7%95%D7%93%D7%A2%D7%95%D7%AA?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:50,407 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/%D7%9E%D7%95%D7%93%D7%A2%D7%95%D7%AA?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:51,064 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/%D7%9E%D7%95%D7%93%D7%A2%D7%95%D7%AA?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:51,749 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/%D7%9E%D7%95%D7%93%D7%A2%D7%95%D7%AA?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:52,463 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/%D7%9E%D7%95%D7%93%D7%A2%D7%95%D7%AA?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:53,350 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/redaktsye?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:16:54,760 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://bechatzros.com/so/74PKHDK0L?languageTag=he&cid=5f031f9f-8018-487b-beab-d77ad078762e&region=8a9610da-1a0d-404b-84c3-4b93bd482699

2026-06-30 12:16:56,135 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://bechatzros.com/so/fePyGQe5I?languageTag=he&cid=c52c5eb5-c200-43ba-9415-1d12ddee7238&region=cf7bc335-39ff-4c0d-a23f-a237bc6a4d1c

2026-06-30 12:16:58,811 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://nuchisushi15.wixforms.com/f/7163612998827770842

2026-06-30 12:17:01,370 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://nuchisushi15.wixforms.com/f/7163609859919708329

2026-06-30 12:17:01,959 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://www.bechatzros.com/?utm_campaign=6120cc49-6ec9-4cdf-b739-58974ca87f02&utm_source=so&utm_medium=mail&cid=e6f143a5-9348-4ff4-9026-749c95d1d735

2026-06-30 12:17:01,972 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: דינסטאג פרשת פינחס • ט"ו תמוז תשפ"ו | בחצרות הקודש

2026-06-30 12:17:02,366 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 18

2026-06-30 12:17:02,395 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 18

2026-06-30 12:17:02,396 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: דינסטאג פרשת פינחס • ט"ו תמוז תשפ"ו | בחצרות הקודש

2026-06-30 12:17:02,396 - social_media_monitor.scrapers.gmail_scraper - INFO - Processed 18 emails, 83 downloads

2026-06-30 12:17:02,401 - social_media_monitor.scrapers.gmail_scraper - INFO - Disconnected from Gmail IMAP

2026-06-30 12:17:02,410 - __main__ - INFO - Scraper gmail completed: 83 results

2026-06-30 12:17:02,411 - __main__ - INFO - Scraper torahanytime completed: 26 results

2026-06-30 12:17:02,411 - __main__ - INFO - Scraper batorah completed: 1 results

2026-06-30 12:17:03,300 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-30 12:17:03.300625

2026-06-30 12:17:03,301 - __main__ - INFO - Email sent successfully

2026-06-30 12:17:03,301 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-30 12:17:03,301 - __main__ - INFO - Monitor complete. Found 110 total results: 1 new batorah results, 26 new torahanytime results, 83 new gmail downloads.

2026-06-30 12:17:03,301 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-30 12:17:03,301 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 12:17:03,406 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-30 12:17:03,406 - __main__ - INFO - Closed all database connections

2026-06-30 12:17:03,412 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 12:17:03,412 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-30 12:30:02,460 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-30.log

2026-06-30 12:30:02,460 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-30.log

2026-06-30 12:30:02,460 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-30.log

2026-06-30 12:30:02,460 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-30 12:30:02,485 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-30 12:30:02,485 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-30 12:30:02,487 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-30 12:30:02,488 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-30 12:30:02,622 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-30 12:30:02,622 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-30 12:30:02,627 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-30 12:30:02,628 - __main__ - INFO - GitHub scraper initialized and enabled

2026-06-30 12:30:02,628 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-06-30 12:30:02,629 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-30 12:30:02,629 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled

2026-06-30 12:30:02,635 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-06-30 12:30:02,635 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-06-30 12:30:02,642 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-30 12:30:02,652 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-06-30 12:30:02,653 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10

2026-06-30 12:30:02,657 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-30 12:30:02,657 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1

2026-06-30 12:30:02,657 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-30 12:30:02,657 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-30 12:30:02,658 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-06-30 12:30:02,753 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)

2026-06-30 12:31:02,996 - LinkedInFeedScraper - ERROR - LinkedIn cookie auto-grab from Chrome (port 9224) failed: Message: session not created: cannot connect to chrome at 127.0.0.1:9224

from chrome not reachable; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception

Stacktrace:

#0 0x6237a57713da <unknown>

#1 0x6237a5152ef0 <unknown>

#2 0x6237a513e76c <unknown>

#3 0x6237a5196b3e <unknown>

#4 0x6237a518bca1 <unknown>

#5 0x6237a51dbd96 <unknown>

#6 0x6237a51db47c <unknown>

#7 0x6237a519ae4f <unknown>

#8 0x6237a519bc31 <unknown>

#9 0x6237a57379f7 <unknown>

#10 0x6237a5736203 <unknown>

#11 0x6237a5720f16 <unknown>

#12 0x6237a5736d9a <unknown>

#13 0x6237a5708eb0 <unknown>

#14 0x6237a575dd58 <unknown>

#15 0x6237a575def5 <unknown>

#16 0x6237a576ff5e <unknown>

#17 0x70b3c289caa4 <unknown>

#18 0x70b3c2929c6c <unknown>

2026-06-30 12:31:02,996 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)

2026-06-30 12:31:03,004 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 0 new posts.

2026-06-30 12:31:04,043 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-30 12:31:04,069 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip

2026-06-30 12:31:04,345 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-06-30 12:31:05,316 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-30 12:31:05,321 - GitHubScraper - INFO - Found 408 GitHub repositories for term: "Hermes Agent"

2026-06-30 12:31:05,862 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-06-30 12:31:06,199 - GitHubScraper - INFO - GitHub feed: 139 fetched across pages, 89 new events for abeperl

2026-06-30 12:31:06,484 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-06-30 12:31:06,486 - GitHubScraper - INFO - Found 55 GitHub repositories for term: multica

2026-06-30 12:31:06,614 - GitHubScraper - INFO - Total GitHub results found: 0

2026-06-30 12:31:06,614 - __main__ - INFO - Scraper github completed: 0 results

2026-06-30 12:31:06,614 - __main__ - INFO - Scraper github_feed completed: 89 results

2026-06-30 12:31:06,614 - __main__ - INFO - Scraper linkedin_feed completed: 0 results

2026-06-30 12:31:06,615 - __main__ - WARNING - LinkedIn Feed: 15 consecutive failures (0 results)

2026-06-30 12:31:07,516 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-30 12:31:07.516828

2026-06-30 12:31:07,517 - __main__ - INFO - Email sent successfully

2026-06-30 12:31:07,517 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-30 12:31:07,517 - __main__ - INFO - Monitor complete. Found 89 total results: 89 new github feed results.

2026-06-30 12:31:07,517 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-30 12:31:07,517 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 12:31:07,582 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-30 12:31:07,582 - __main__ - INFO - Closed all database connections

2026-06-30 12:31:07,584 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 12:31:07,584 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-06-30 13:00:02,138 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-30.log

2026-06-30 13:00:02,138 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-30.log

2026-06-30 13:00:02,138 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-30.log

2026-06-30 13:00:02,141 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-06-30 13:00:02,166 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-06-30 13:00:02,166 - __main__ - INFO - Configuration loaded and validated successfully

2026-06-30 13:00:02,168 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-06-30 13:00:02,168 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-06-30 13:00:02,185 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-06-30 13:00:02,185 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-06-30 13:00:02,188 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully

2026-06-30 13:00:02,189 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-06-30 13:00:02,189 - __main__ - INFO - RSS scraper initialized and enabled

2026-06-30 13:00:02,192 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-06-30 13:00:02,192 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-06-30 13:00:02,192 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-06-30 13:00:02,194 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-06-30 13:00:02,199 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-06-30 13:00:02,199 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10

2026-06-30 13:00:02,201 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-06-30 13:00:02,201 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1

2026-06-30 13:00:02,201 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0

2026-06-30 13:00:02,201 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-06-30 13:00:02,201 - __main__ - INFO - Running 3 scrapers concurrently...

2026-06-30 13:00:02,201 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-06-30 13:00:02,313 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-06-30 13:00:02,318 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters

2026-06-30 13:00:02,318 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-06-30 13:00:02,320 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-06-30 13:00:02,647 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/

2026-06-30 13:00:03,020 - RSSFeedScraper - INFO - Total RSS/HTML results: 4

2026-06-30 13:00:03,442 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-06-30 13:00:03,663 - Yiddish24Scraper - INFO - Received response with 477028 characters

2026-06-30 13:00:03,665 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (303406 chars)

2026-06-30 13:00:03,667 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-06-30 13:00:03,771 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-06-30 13:00:03,818 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements

2026-06-30 13:00:03,818 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1

2026-06-30 13:00:04,521 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles

2026-06-30 13:00:04,522 - Yiddish24Scraper - INFO - Page 1: 0/99 new items

2026-06-30 13:00:04,522 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-06-30 13:00:04,522 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-06-30 13:00:14,869 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-06-30 13:01:06,441 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-06-30 13:01:07,082 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.

2026-06-30 13:01:07,082 - IveltScraper - INFO - All forums scrape complete. Found 5 new posts.

2026-06-30 13:01:07,083 - __main__ - INFO - Scraper rss completed: 4 results

2026-06-30 13:01:07,083 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-06-30 13:01:07,083 - __main__ - INFO - Scraper ivelt completed: 5 results

2026-06-30 13:01:08,575 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-30 13:01:08.575433

2026-06-30 13:01:08,575 - __main__ - INFO - Email sent successfully

2026-06-30 13:01:08,576 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-06-30 13:01:08,576 - __main__ - INFO - Monitor complete. Found 9 total results: 4 new rss results, 5 new ivelt results.

2026-06-30 13:01:08,576 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-06-30 13:01:08,576 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 13:01:08,637 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-06-30 13:01:08,637 - __main__ - INFO - Closed all database connections

2026-06-30 13:01:08,639 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-06-30 13:01:08,640 - social_media_monitor.database.connection - INFO - Closed 0 database connections