← Logs

social_media_monitor_2026-05-11.log

2026-05-11 20:30:02,367 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-11 20:30:02,367 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-11 20:30:02,367 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-11 20:30:02,367 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-11 20:30:02,367 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-11 20:30:03,359 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-11 20:30:03,392 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Using AionUi
2026-05-11 20:30:03,402 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Context window reduced to 32K?
2026-05-11 20:30:03,414 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Built an hermes agent skill that can operate Odoo ERP through chat
2026-05-11 20:30:03,422 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Koristili neko Hermes agent. koji api, ili subscription?
2026-05-11 20:30:04,630 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-05-11 20:30:04,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-11 20:30:04,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-11 20:30:04,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-11 20:30:05,600 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-11 20:30:05,632 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: how much would sightseer be worth?
2026-05-11 20:30:06,797 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-11 20:30:06,797 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-11 20:30:06,797 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-11 20:30:06,797 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-11 20:30:07,813 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-11 20:30:09,062 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-11 20:30:09,063 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-11 20:30:09,063 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-11 20:30:09,063 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-11 20:30:09,990 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: v3 of my custom memory system is live
2026-05-11 20:30:10,000 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Restarting Hermes kills your agent and erases its skills?
2026-05-11 20:30:10,010 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/claudexplorers: v3 of my memory system is live
2026-05-11 20:30:10,019 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Using AionUi
2026-05-11 20:30:10,028 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/kimi: Context window reduced to 32K?
2026-05-11 20:30:10,037 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Does anyone actually have stable agents that communicate together and
2026-05-11 20:30:10,047 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Built an hermes agent skill that can operate Odoo ERP through chat
2026-05-11 20:30:10,055 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/askbosnia: Koristili neko Hermes agent. koji api, ili subscription?
2026-05-11 20:30:11,208 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-11 20:30:12,354 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ClaudeCode: When you vibe-code an app but can't vibe-code paying users. Also my wi
2026-05-11 20:30:13,430 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-11 20:30:15,698 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-11 20:30:17,854 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-11 20:30:17,855 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-11 20:30:20,196 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-11 20:30:22,173 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-11 20:30:24,301 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/ClaudeCode+ClaudeAI+claude+vibecoding (limit=25)
2026-05-11 20:30:24,301 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude agent via RSS
2026-05-11 20:30:25,334 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Preventing LLM Code Drift with a Persistent Decision Brain
2026-05-11 20:30:25,346 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Advanced Self-Hosted Personal AI 'Brain' Architecture with
2026-05-11 20:30:25,358 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Automated Agent Harness Optimization with Autoharness for C
2026-05-11 20:30:25,371 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Integrating a Dynamic, Read/Write Knowledge Base (Wiki) wit
2026-05-11 20:30:25,385 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Claude Code Workflow: Parallel GitHub Issue Management with
2026-05-11 20:30:25,400 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Structured Claude Code Workflow: Treating AI as a Dev with
2026-05-11 20:30:25,412 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Efficient Claude Code Workflow: Managing Context and Tokens
2026-05-11 20:30:25,421 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/GrowthHacking: We built 4 things that make AI search engines recommend our product. C
2026-05-11 20:30:25,430 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/SaaS: 9,000 lines of code, solo founder, $99/month SaaS. The unglamorous rea
2026-05-11 20:30:25,460 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/GoogleGeminiAI: Gemini model lifecycle is incompatible with production workloads. Does
2026-05-11 20:30:25,488 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeAI: How does claude chat generate such long documents?
2026-05-11 20:30:25,536 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Freelancers: Yes, freelancing is still very much possible in the AI era (even a big
2026-05-11 20:30:25,545 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/bindingofisaac: There are maybe 3 people besides me that actually need that, but I wan
2026-05-11 20:30:25,559 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: A practical way to run Claude Code tasks in parallel without turning y
2026-05-11 20:30:25,584 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/SoftwareEngineerJobs: [US] 30+ Software Engineer jobs that opened this week (remote, hybrid)
2026-05-11 20:30:25,616 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeAI: What improved my Claude Code workflow: stop treating it like chat, sta
2026-05-11 20:30:25,627 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: How to spend less time on fixing bugs.
2026-05-11 20:30:25,640 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ZaiGLM: Did Z.ai improved coding plan
2026-05-11 20:30:26,640 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude code agent via RSS
2026-05-11 20:30:27,575 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/LocalLLM: M4 / 48gb best models?
2026-05-11 20:30:27,586 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/LangChain: For production agents, I’m starting to think “workspace state” matters
2026-05-11 20:30:27,595 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: Multi vendor bus booking webapp stack
2026-05-11 20:30:27,610 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Generate Claude MCP Servers from OpenAPI Specs with `mcp-ge
2026-05-11 20:30:27,622 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/RepsFashionDogs: [Review] $6 Nike Running Division Shorts Via GTBUY
2026-05-11 20:30:27,631 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/LocalLLM: Based on real life events.
2026-05-11 20:30:27,641 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AIDiscussion: Are AI agents actually becoming useful beyond chat,
2026-05-11 20:30:27,650 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Stuck at allocating sandbox
2026-05-11 20:30:27,660 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ChatGPT: vibe coded a LinkedIn AI tool with Claude, hit $2k first month, here's
2026-05-11 20:30:27,670 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AppBusiness: I published LED flash alert Utility app for Android and kept it under
2026-05-11 20:30:27,679 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/hermesagent: v3 of my custom memory system is live
2026-05-11 20:30:27,689 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/claudexplorers: v3 of my memory system is live
2026-05-11 20:30:28,690 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: AI coding agent via RSS
2026-05-11 20:30:29,678 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AIToolTesting: Do You Have an AI Companion?
2026-05-11 20:30:29,686 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_mega-mod: Unity AI Open Beta Review: I Tested It for 3 Days — Here’s the Brutal
2026-05-11 20:30:29,706 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ChatGPTPro: ChatGPT works far better when you treat it like a thinking partner, no
2026-05-11 20:30:29,715 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/viagens: Imigração em CDG
2026-05-11 20:30:29,726 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ArtificialInteligence: We built persistent cloud computers for agents. Here’s what changed vs
2026-05-11 20:30:29,737 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ProductivityApps: Made an extension that a Cat tutor's you to stop using phone while wor
2026-05-11 20:30:29,746 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/devskenya: Ai
2026-05-11 20:30:29,756 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/csMajors: Google is testing new interview process for software engineering roles
2026-05-11 20:30:30,756 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-11 20:30:32,789 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 47
2026-05-11 20:30:32,790 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-11 20:30:32,921 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-11 20:30:33,358 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-11 20:30:47,751 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-11 20:31:02,174 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-11 20:31:16,198 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-11 20:31:16,199 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-11 20:31:16,888 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-11 20:31:18,097 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-11 20:31:19,286 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-11 20:31:20,029 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.
2026-05-11 20:31:20,029 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-11 20:31:26,942 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-11 20:31:26,968 - GitHubScraper - INFO - Found 226 GitHub repositories for term: paperclip
2026-05-11 20:31:28,100 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-11 20:31:28,103 - GitHubScraper - INFO - Found 203 GitHub repositories for term: "Hermes Agent"
2026-05-11 20:31:29,296 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-11 20:31:29,388 - GitHubScraper - INFO - Found 43 GitHub repositories for term: multica
2026-05-11 20:31:29,538 - GitHubScraper - INFO - Total GitHub results found: 0
2026-05-11 20:31:29,538 - __main__ - INFO - Scraper reddit completed: 52 results
2026-05-11 20:31:29,538 - __main__ - INFO - Scraper github completed: 0 results
2026-05-11 20:31:29,538 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-11 20:31:29,538 - __main__ - INFO - Scraper linkedin completed: 0 results
2026-05-11 20:31:29,538 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-11 20:31:30,320 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-11 20:31:30.320533
2026-05-11 20:31:30,320 - __main__ - INFO - Email sent successfully
2026-05-11 20:31:30,321 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-11 20:31:30,321 - __main__ - INFO - Monitor complete. Found 52 total results: 52 new reddit results.
2026-05-11 20:31:30,321 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-11 20:31:30,321 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-11 20:31:30,460 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-11 20:31:30,460 - __main__ - INFO - Closed all database connections
2026-05-11 20:31:30,501 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-11 20:31:30,515 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-11 21:00:01,813 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-11.log
2026-05-11 21:00:01,814 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-11.log
2026-05-11 21:00:01,814 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-11.log
2026-05-11 21:00:01,814 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-11 21:00:01,838 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-11 21:00:01,838 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-11 21:00:01,840 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-11 21:00:01,840 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-11 21:00:01,856 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-11 21:00:01,856 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-11 21:00:01,857 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-11 21:00:01,858 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-11 21:00:01,858 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-11 21:00:01,860 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-11 21:00:01,860 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-11 21:00:01,860 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-11 21:00:01,862 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-11 21:00:01,866 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-11 21:00:01,866 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-11 21:00:01,868 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-11 21:00:01,868 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-11 21:00:01,868 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-11 21:00:01,868 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-11 21:00:01,868 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-11 21:00:01,869 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-11 21:00:01,965 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-11 21:00:01,969 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-11 21:00:01,969 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-11 21:00:01,970 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-11 21:00:02,323 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-11 21:00:02,770 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-11 21:00:03,491 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-11 21:00:04,323 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-11 21:00:05,447 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-11 21:00:06,327 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-11 21:00:07,493 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-11 21:00:08,332 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-11 21:00:09,498 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"
2026-05-11 21:00:10,497 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-11 21:00:11,335 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-11 21:00:12,494 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-11 21:00:13,340 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-11 21:00:14,519 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-11 21:00:15,341 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-11 21:00:15,478 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-11 21:00:16,531 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-11 21:00:17,344 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-11 21:00:18,506 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-11 21:00:30,289 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-11 21:00:30,298 - Yiddish24Scraper - INFO - Received response with 512094 characters
2026-05-11 21:00:30,301 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318681 chars)
2026-05-11 21:00:30,305 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-11 21:00:30,383 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-11 21:00:30,431 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-11 21:00:30,432 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-11 21:00:31,267 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-05-11 21:00:31,268 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-05-11 21:00:31,268 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-05-11 21:00:31,268 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-05-11 21:00:31,302 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-11 21:00:31,517 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-11 21:00:32,335 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-11 21:00:33,542 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-11 21:00:33,564 - RSSFeedScraper - INFO - Total RSS/HTML results: 22
2026-05-11 21:02:04,965 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 46 new posts.
2026-05-11 21:02:04,965 - __main__ - INFO - Scraper rss completed: 22 results
2026-05-11 21:02:04,965 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-05-11 21:02:04,965 - __main__ - INFO - Scraper ivelt completed: 46 results
2026-05-11 21:02:05,676 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-11 21:02:05.676126
2026-05-11 21:02:05,676 - __main__ - INFO - Email sent successfully
2026-05-11 21:02:05,676 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-11 21:02:05,676 - __main__ - INFO - Monitor complete. Found 74 total results: 22 new rss results, 6 new yiddish24 results, 46 new ivelt results.
2026-05-11 21:02:05,676 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-11 21:02:05,677 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-11 21:02:05,772 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-11 21:02:05,773 - __main__ - INFO - Closed all database connections
2026-05-11 21:02:05,775 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-11 21:02:05,775 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-11 22:00:02,578 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-11.log
2026-05-11 22:00:02,578 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-11.log
2026-05-11 22:00:02,579 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-11.log
2026-05-11 22:00:02,579 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-11 22:00:02,603 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-11 22:00:02,603 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-11 22:00:02,607 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-11 22:00:02,607 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-11 22:00:02,630 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-11 22:00:02,630 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-11 22:00:02,676 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-11 22:00:02,677 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-11 22:00:02,677 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-11 22:00:02,681 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-11 22:00:02,681 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-11 22:00:02,681 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-11 22:00:02,684 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-11 22:00:02,688 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-11 22:00:02,688 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-11 22:00:02,690 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-11 22:00:02,690 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-11 22:00:02,690 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-11 22:00:02,690 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-11 22:00:02,690 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-11 22:00:02,690 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-11 22:00:02,784 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-11 22:00:02,788 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-11 22:00:02,788 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-11 22:00:02,789 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-11 22:00:03,095 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-11 22:00:03,494 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-11 22:00:04,056 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-11 22:00:04,893 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-11 22:00:06,017 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-11 22:00:06,896 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-11 22:00:07,050 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-11 22:00:07,296 - Yiddish24Scraper - INFO - Received response with 511335 characters
2026-05-11 22:00:07,299 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318903 chars)
2026-05-11 22:00:07,302 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-11 22:00:07,389 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-11 22:00:07,430 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-11 22:00:07,430 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-11 22:00:08,256 - Yiddish24Scraper - INFO - Page 1 summary: 12 new out of 100 total articles
2026-05-11 22:00:08,256 - Yiddish24Scraper - INFO - Page 1: 12/100 new items
2026-05-11 22:00:08,256 - Yiddish24Scraper - INFO - Low new item ratio (12.0%), stopping pagination
2026-05-11 22:00:08,257 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 12
2026-05-11 22:00:08,424 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-11 22:00:09,273 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-11 22:00:10,411 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"
2026-05-11 22:00:11,402 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-11 22:00:12,273 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-11 22:00:13,422 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-11 22:00:14,278 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-11 22:00:14,945 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-11 22:00:15,400 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-11 22:00:16,280 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-11 22:00:20,672 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-11 22:00:21,536 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-11 22:00:22,657 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-11 22:00:28,836 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-11 22:00:29,938 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-11 22:00:30,815 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-11 22:00:32,042 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-11 22:00:32,062 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-11 22:00:37,479 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 21 new posts.
2026-05-11 22:00:37,480 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-11 22:00:37,480 - __main__ - INFO - Scraper yiddish24 completed: 12 results
2026-05-11 22:00:37,480 - __main__ - INFO - Scraper ivelt completed: 21 results
2026-05-11 22:00:38,170 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-11 22:00:38.169931
2026-05-11 22:00:38,170 - __main__ - INFO - Email sent successfully
2026-05-11 22:00:38,170 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-11 22:00:38,170 - __main__ - INFO - Monitor complete. Found 36 total results: 3 new rss results, 12 new yiddish24 results, 21 new ivelt results.
2026-05-11 22:00:38,170 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-11 22:00:38,170 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-11 22:00:38,310 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-11 22:00:38,310 - __main__ - INFO - Closed all database connections
2026-05-11 22:00:38,312 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-11 22:00:38,312 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-11 22:30:01,660 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-11.log
2026-05-11 22:30:01,660 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-11.log
2026-05-11 22:30:01,660 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-11.log
2026-05-11 22:30:01,660 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-11 22:30:01,683 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-11 22:30:01,683 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-11 22:30:01,683 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-11 22:30:01,685 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-11 22:30:01,686 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-11 22:30:01,700 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-11 22:30:01,701 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-11 22:30:01,703 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-11 22:30:01,703 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-11 22:30:01,703 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-11 22:30:01,703 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-11 22:30:01,704 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-11 22:30:01,705 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-11 22:30:01,705 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-11 22:30:01,711 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-11 22:30:01,711 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-11 22:30:01,717 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-11 22:30:01,728 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-11 22:30:01,728 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-11 22:30:01,734 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-11 22:30:01,734 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-11 22:30:01,735 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-11 22:30:01,735 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-11 22:30:01,735 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-11 22:30:01,735 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-11 22:30:02,748 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-11 22:30:02,786 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Why Gpt5.5 sucks in Hermes Agent and you should use Gpt5.4 instead
2026-05-11 22:30:04,033 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-11 22:30:04,034 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-11 22:30:04,034 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-11 22:30:04,034 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-11 22:30:05,414 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-11 22:30:05,454 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Help
2026-05-11 22:30:05,462 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I'm broke and I broke my castle.
2026-05-11 22:30:05,473 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Mini-Me is small and evil. Now what is steel and intimidating?
2026-05-11 22:30:05,531 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Squiggly sculpture just peaced out
2026-05-11 22:30:06,628 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-05-11 22:30:06,628 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-11 22:30:06,628 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-11 22:30:06,628 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-11 22:30:07,720 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-11 22:30:08,985 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-11 22:30:08,986 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-11 22:30:08,986 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-11 22:30:08,986 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-11 22:30:09,888 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Why Gpt5.5 sucks in Hermes Agent and you should use Gpt5.4 instead
2026-05-11 22:30:09,896 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Training your hermes
2026-05-11 22:30:11,110 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-11 22:30:13,185 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-11 22:30:15,453 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-11 22:30:17,607 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-11 22:30:17,607 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-11 22:30:20,096 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-11 22:30:22,098 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-11 22:30:24,202 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/ClaudeCode+ClaudeAI+claude+vibecoding (limit=25)
2026-05-11 22:30:24,203 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude agent via RSS
2026-05-11 22:30:25,077 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Maximizing 1M Context with Opus Calibration and Sonnet Suba
2026-05-11 22:30:25,086 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/nextjs: v0 + usage-based billing: integration via MCP server (Next.js apps, re
2026-05-11 22:30:25,097 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Dear Anthropic - managing EVERYTHING from my iphone. When??
2026-05-11 22:30:25,108 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/buildinpublic: Looking for early adopters for a tiny macOS app for AI coding-agent us
2026-05-11 22:30:25,121 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_Upstairs-Cup-8666: Snowflake Backup Assistant Agent
2026-05-11 22:30:25,131 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/cofounderhunt: AI/ML engineer looking to work with an early-age startup.
2026-05-11 22:30:25,142 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/iOSProgramming: Xcode Trace Analyzer MCP
2026-05-11 22:30:25,153 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: I built a full 3D Artemis II mission explorer with AI agents writing 1
2026-05-11 22:30:25,162 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/OpenSourceeAI: I built a desktop control plane for AI coding agents and need early te
2026-05-11 22:30:25,193 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/PythonProjects2: Built a small open-source CLI to give coding agents repo-local continu
2026-05-11 22:30:25,222 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/DeepSeek: First experience using the API
2026-05-11 22:30:25,246 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/n8n: [Fully Open source] Machinaos: Token to work and $$ Converter, Opencla
2026-05-11 22:30:25,274 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_KatieFrankMarketing: Growth marketer open to work: B2B SaaS, technical audiences, creative
2026-05-11 22:30:25,320 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Claude Code already git-tracks half its memory — why not the other hal
2026-05-11 22:30:25,333 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: New in Claude Code: agent view.
2026-05-11 22:30:25,348 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_Scared_End_3626: Multi-agent file coordination + change verification — six new MCP tool
2026-05-11 22:30:25,358 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Accounting: What are yall doing to prepare for AI?
2026-05-11 22:30:25,368 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/hermesagent: Training your hermes
2026-05-11 22:30:26,369 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude code agent via RSS
2026-05-11 22:30:27,326 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Claude as Cognitive Scaffolding: Habits for Project Managem
2026-05-11 22:30:27,337 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Efficient Codebase Memory Management with `codebase-memory-
2026-05-11 22:30:27,346 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/replit: Replit is such a ripoff
2026-05-11 22:30:27,361 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Robust LLM Integration Patterns: Prompt Caching, Multilingu
2026-05-11 22:30:27,371 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/brisbane: Claude community
2026-05-11 22:30:27,380 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/tecnologiaLatam: Anthropic con Claude sus nuevas formas de pago
2026-05-11 22:30:27,391 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/devsarg: Sirve Claude para Data Engineer? Que tanto usan la IA los DE?
2026-05-11 22:30:27,404 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/RepsFashionDogs: [Review] Argentina 2026 Training Jersey From Okkinetic Via GTBUY
2026-05-11 22:30:27,415 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/coding_agents: Contral is a "teaching IDE" so you can code and learn
2026-05-11 22:30:27,428 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Desktop takes forever?
2026-05-11 22:30:27,437 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: How are you all actually managing token costs in long Claude/GPT sessi
2026-05-11 22:30:27,447 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/InstagramMarketing: Made a tool to help me create content faster. Would appreciate some fe
2026-05-11 22:30:27,459 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/cscareerquestions: Feels like anyone can do what i do now
2026-05-11 22:30:27,473 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AI_Agents: Has Anyone Built a Consumer AI Agent That Can Write Its Own Tools?
2026-05-11 22:30:27,482 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AskFounder: Launched. Got views. Got silence. Trying to figure out what that means
2026-05-11 22:30:27,508 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Fallout: Fallout 5 concept
2026-05-11 22:30:28,508 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: AI coding agent via RSS
2026-05-11 22:30:29,439 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_dr_Deep_PetClinic: Artificial insemination
2026-05-11 22:30:29,451 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AIToolsAndTips: Zero-Storage Plex Media Server — Stream Everything From Debrid, Nothin
2026-05-11 22:30:29,462 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/nestjs: Anyone here experimenting with AI orchestration for NestJS backends?
2026-05-11 22:30:29,471 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_airbyteInc: Airbyte Agents is Live
2026-05-11 22:30:29,480 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/InterviewCoderPro: Just finished my Harvey AI interview and wanted to share the two codin
2026-05-11 22:30:29,502 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/IntrovertsSafeDating: Safety Reminder: Age Rules, Scams, and Protecting Yourself Here
2026-05-11 22:30:29,512 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/SiliconAlley: Who’s actually hiring in the Bay Area right now? (Startup Intel Thread
2026-05-11 22:30:29,521 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/n8n: I built an n8n workflow that turns every Notion doc I write into a vid
2026-05-11 22:30:29,540 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_elogic_commerce: How I work: the four-step decision framework
2026-05-11 22:30:29,549 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/hypeurls: Show HN: E2a – Open-source email gateway for AI agents
2026-05-11 22:30:29,563 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/banidinaplicatiiRO: Hai să facem bani amândoi, îți explic pas cu pas regulile | 900 RON GA
2026-05-11 22:30:30,575 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-11 22:30:32,494 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 47
2026-05-11 22:30:32,494 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-11 22:30:32,623 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-11 22:30:33,084 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-11 22:30:47,316 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-11 22:31:01,299 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-11 22:31:14,836 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-11 22:31:14,837 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-11 22:31:15,375 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-11 22:31:16,637 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-11 22:31:17,076 - LinkedInScraper - INFO - New LinkedIn post: The interesting fact about OpenClaw and Hermes Agent isn't that they d
2026-05-11 22:31:17,259 - LinkedInScraper - INFO - New LinkedIn post: If you have spent time working with LLMs you have probably noticed tha
2026-05-11 22:31:17,952 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-11 22:31:18,275 - LinkedInScraper - INFO - New LinkedIn post: MultiCare Health System Hospital Week 2026 - LinkedIn
2026-05-11 22:31:18,695 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 3 new results.
2026-05-11 22:31:18,695 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-11 22:31:25,722 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-11 22:31:25,747 - GitHubScraper - INFO - Found 226 GitHub repositories for term: paperclip
2026-05-11 22:31:26,783 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-11 22:31:26,789 - GitHubScraper - INFO - Found 203 GitHub repositories for term: "Hermes Agent"
2026-05-11 22:31:26,904 - GitHubScraper - INFO - Added new GitHub repository: dotfiles
2026-05-11 22:31:27,862 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-11 22:31:27,957 - GitHubScraper - INFO - Found 43 GitHub repositories for term: multica
2026-05-11 22:31:28,105 - GitHubScraper - INFO - Total GitHub results found: 1
2026-05-11 22:31:28,106 - __main__ - INFO - Scraper reddit completed: 52 results
2026-05-11 22:31:28,106 - __main__ - INFO - Scraper github completed: 1 results
2026-05-11 22:31:28,106 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-11 22:31:28,106 - __main__ - INFO - Scraper linkedin completed: 3 results
2026-05-11 22:31:28,106 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-11 22:31:28,847 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-11 22:31:28.847177
2026-05-11 22:31:28,847 - __main__ - INFO - Email sent successfully
2026-05-11 22:31:28,847 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-11 22:31:28,847 - __main__ - INFO - Monitor complete. Found 56 total results: 52 new reddit results, 1 new github results, 3 new linkedin results.
2026-05-11 22:31:28,847 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-11 22:31:28,848 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-11 22:31:29,002 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-11 22:31:29,002 - __main__ - INFO - Closed all database connections
2026-05-11 22:31:29,043 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-11 22:31:29,058 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-11 23:00:01,691 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-11.log
2026-05-11 23:00:01,692 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-11.log
2026-05-11 23:00:01,692 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-11.log
2026-05-11 23:00:01,692 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-11 23:00:01,714 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-11 23:00:01,714 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-11 23:00:01,716 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-11 23:00:01,717 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-11 23:00:01,734 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-11 23:00:01,734 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-11 23:00:01,735 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-11 23:00:01,736 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-11 23:00:01,736 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-11 23:00:01,738 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-11 23:00:01,738 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-11 23:00:01,738 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-11 23:00:01,741 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-11 23:00:01,745 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-11 23:00:01,745 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-11 23:00:01,747 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-11 23:00:01,747 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-11 23:00:01,747 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-11 23:00:01,747 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-11 23:00:01,747 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-11 23:00:01,747 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-11 23:00:01,837 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-11 23:00:01,842 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-11 23:00:01,842 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-11 23:00:01,843 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-11 23:00:02,110 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-11 23:00:02,527 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-11 23:00:03,060 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-11 23:00:03,896 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-11 23:00:05,019 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-11 23:00:05,898 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-11 23:00:07,035 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-11 23:00:07,037 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-11 23:00:07,285 - Yiddish24Scraper - INFO - Received response with 501299 characters
2026-05-11 23:00:07,288 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (316257 chars)
2026-05-11 23:00:07,291 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-11 23:00:07,375 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-11 23:00:07,414 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-11 23:00:07,414 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-11 23:00:08,347 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles
2026-05-11 23:00:08,347 - Yiddish24Scraper - INFO - Page 1: 3/100 new items
2026-05-11 23:00:08,347 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination
2026-05-11 23:00:08,348 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3
2026-05-11 23:00:08,357 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-11 23:00:09,518 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"
2026-05-11 23:00:10,515 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-11 23:00:11,363 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-11 23:00:12,538 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-11 23:00:13,365 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-11 23:00:13,920 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-11 23:00:14,489 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-11 23:00:15,368 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-11 23:00:16,617 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-11 23:00:17,119 - IveltScraper - INFO - Ivelt scrape complete. Checked 1 topics, found 1 new posts.
2026-05-11 23:00:17,370 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-11 23:00:18,498 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-11 23:00:19,373 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-11 23:00:20,509 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-11 23:00:21,377 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-11 23:00:22,537 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-11 23:00:22,557 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-11 23:00:22,557 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-11 23:00:22,558 - __main__ - INFO - Scraper yiddish24 completed: 3 results
2026-05-11 23:00:22,558 - __main__ - INFO - Scraper ivelt completed: 1 results
2026-05-11 23:00:23,150 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-11 23:00:23.150091
2026-05-11 23:00:23,150 - __main__ - INFO - Email sent successfully
2026-05-11 23:00:23,150 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-11 23:00:23,150 - __main__ - INFO - Monitor complete. Found 7 total results: 3 new rss results, 3 new yiddish24 results, 1 new ivelt results.
2026-05-11 23:00:23,150 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-11 23:00:23,150 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-11 23:00:23,197 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-11 23:00:23,197 - __main__ - INFO - Closed all database connections
2026-05-11 23:00:23,199 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-11 23:00:23,199 - social_media_monitor.database.connection - INFO - Closed 0 database connections