← Logs

social_media_monitor_2026-05-07.log

2026-05-07 20:30:02,656 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-07 20:30:02,658 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-07 20:30:02,663 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-07 20:30:02,663 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-07 20:30:02,665 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-07 20:30:02,665 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-07 20:30:02,665 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-07 20:30:02,665 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-07 20:30:02,666 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-07 20:30:02,666 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-07 20:30:03,650 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-07 20:30:03,697 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Workspace - enhancedchat and mcp.
2026-05-07 20:30:03,717 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I Tried Hermes AI Agent Videos And The Self-Learning Part Is Wild
2026-05-07 20:30:03,727 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Launched and automated a YT channel with Hermes Agent - almost at 10k
2026-05-07 20:30:03,737 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: New Hermes Agent Videos Update Just Changed AI Agents Forever
2026-05-07 20:30:05,039 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-05-07 20:30:05,039 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-07 20:30:05,039 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-07 20:30:05,039 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-07 20:30:06,165 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-07 20:30:06,203 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Your work space
2026-05-07 20:30:06,217 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Paper clip
2026-05-07 20:30:06,227 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: You get $10 million if you can hide a paperclip from the entire FBI fo
2026-05-07 20:30:06,241 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: [WTS] MOTHERS DAY GOLD AND SILVER DEALS!!! FREE SHIPPING ON ORDERS $25
2026-05-07 20:30:06,250 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hairclip Fix
2026-05-07 20:30:07,498 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 5
2026-05-07 20:30:07,499 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-07 20:30:07,499 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-07 20:30:07,499 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-07 20:30:08,433 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-07 20:30:09,679 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-07 20:30:09,679 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-07 20:30:09,679 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-07 20:30:09,680 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-07 20:30:10,703 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Hermes Workspace - enhancedchat and mcp.
2026-05-07 20:30:10,718 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: I Tried Hermes AI Agent Videos And The Self-Learning Part Is Wild
2026-05-07 20:30:10,731 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Launched and automated a YT channel with Hermes Agent - almost at 10k
2026-05-07 20:30:10,746 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: New Hermes Agent Videos Update Just Changed AI Agents Forever
2026-05-07 20:30:11,915 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-07 20:30:14,034 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-07 20:30:16,089 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/LocalLLM: 122B, is it worth it?
2026-05-07 20:30:17,577 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-07 20:30:20,208 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-07 20:30:20,208 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-07 20:30:21,485 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'paperclip_ai' r/JewelryForSale: [WTS] MOTHERS DAY GOLD AND SILVER DEALS!!! FREE SHIPPING ON ORDERS $25
2026-05-07 20:30:22,821 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-07 20:30:26,956 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-07 20:30:29,666 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/ClaudeCode+ClaudeAI+claude+vibecoding (limit=25)
2026-05-07 20:30:29,666 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude agent via RSS
2026-05-07 20:30:30,811 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/udemyfreebies: 🎓 156 FREE Udemy Courses - 2026-05-08
2026-05-07 20:30:30,820 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AI_Agents: Whats the best orchestration framework?
2026-05-07 20:30:30,831 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Compress Large Java/Spring Monorepos for Claude Context wit
2026-05-07 20:30:30,843 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Multi-Model Claude Workflow for Large Projects: Opus for Pl
2026-05-07 20:30:30,857 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Advanced Prompt for Generating Phased Software Implementati
2026-05-07 20:30:30,882 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/coolgithubprojects: Built a repo-local continuity layer for coding agents. It helps each n
2026-05-07 20:30:30,896 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/GithubCopilot: My Copilot CLI workflow after a month: one window, every past session
2026-05-07 20:30:30,907 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/GetAIAcademy: ChatGPT vs Claude vs Perplexity vs Gemini vs NotebookLM for Real Estat
2026-05-07 20:30:30,916 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Anyone else feel like the honeymoon phase is coming to an end?
2026-05-07 20:30:30,925 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Superframeworks: OpenClaw hit 150K GitHub stars in 72 hours. 5 businesses you can build
2026-05-07 20:30:30,949 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/devopsjobs: [Hiring] [US] 30+ Devops jobs that opened this week (remote, hybrid)
2026-05-07 20:30:30,958 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AiAutomations: I 99% Automated my Job (SWE)
2026-05-07 20:30:30,968 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/electronjs: Built a multiplexer for AI CLI sessions in Electron — node-pty + xterm
2026-05-07 20:30:30,977 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Got tired of Claude Code usage limits breaking my flow, so I built Gui
2026-05-07 20:30:30,988 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/accelerate: Mozilla says 271 vulnerabilities found by Mythos have "almost no false
2026-05-07 20:30:31,002 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/WebAfterAI: OpenAI Just Dropped /goal in Codex – Set a Goal and Walk Away!
2026-05-07 20:30:31,013 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/kimi: I am currently building the ultimate AI Agent tool that make every ai
2026-05-07 20:30:31,025 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeAI: I built an open-source CLI to compress large Java/Spring monorepos int
2026-05-07 20:30:31,036 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/SaaS: 99% of your SaaS are bullshit
2026-05-07 20:30:31,048 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: Making vibe coding agent sessions reusable across projects
2026-05-07 20:30:31,057 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: Built a thing called Guild because my multi-agent setups kept falling
2026-05-07 20:30:31,068 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/SaaS: We hit $10K MRR this morning. Here's exactly what we're doing to get c
2026-05-07 20:30:32,068 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude code agent via RSS
2026-05-07 20:30:32,983 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/BangaloreSocial: Something interesting to work on
2026-05-07 20:30:32,992 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AI_Agents: Bigger context windows won’t fix AI coding
2026-05-07 20:30:33,000 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/redditstock: At least they’re paying for ads now
2026-05-07 20:30:33,015 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Innovative AI Workflow for Game Development: Physics-to-Art
2026-05-07 20:30:33,025 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/kimi: I am impressed with Kimi 2.6 > GLM 5.1
2026-05-07 20:30:33,033 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/opencode: How to add my GEMINI.md rules to all opencode (openrouter api models)
2026-05-07 20:30:33,042 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ChatGPTcomplaints: Elon Musk just supercharged Anthropic with over 300 megawatts of raw p
2026-05-07 20:30:33,055 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Anthropic: Can my Claude Code Sessions be exported (Team Premium Account)?
2026-05-07 20:30:33,076 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Can my Claude Code Sessions be exported (Team Premium Account)?
2026-05-07 20:30:33,088 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/foodstamps: Interview Scheduling Q
2026-05-07 20:30:33,096 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/couchsurfing: New update looks like it was vibe-coded and published directly from lo
2026-05-07 20:30:33,106 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Entrepreneurs: I interned at a toxic AI startup in Bangalore and watched grown men LA
2026-05-07 20:30:33,114 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/DeepSeek: is this a normal behavior for deepseek to do??
2026-05-07 20:30:34,115 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: AI coding agent via RSS
2026-05-07 20:30:35,076 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/learnAIAgents: Why do so many AI agent projects feel overhyped lately?
2026-05-07 20:30:35,088 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Referral: [May 2026] Kling AI Referral Code – Get 50% Bonus Credits
2026-05-07 20:30:35,097 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/analytics: £3000 budget to learn fabric and AI
2026-05-07 20:30:35,110 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/StartUpIndia: Why India Is Nowhere Close to the Next Silicon Valley: Insight's from
2026-05-07 20:30:35,121 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/appledevelopers: DropK- Your Minimal tray + clipboard app that makes repositioning file
2026-05-07 20:30:35,131 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/CanadaReferralCodes: Économisez 25 $ sur votre facture EBOX avec le code ami GE911
2026-05-07 20:30:35,139 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/cursor: my full workflow for building features in cursor. sharing because it t
2026-05-07 20:30:35,149 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/GetAIAcademy: How Real Estate Agents Can Use Google Vids for Client Education
2026-05-07 20:30:35,157 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/IndianTeenagers: BEAWAREEE OF THISS SCAM
2026-05-07 20:30:35,166 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/softwarekings: What Software Can’t You Work Without in 2026?
2026-05-07 20:30:36,167 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-07 20:30:38,204 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 51
2026-05-07 20:30:38,204 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-07 20:30:38,322 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-07 20:30:38,824 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-07 20:30:54,160 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-07 20:31:09,325 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-07 20:31:23,887 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-07 20:31:23,887 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-07 20:31:24,389 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-07 20:31:25,746 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-07 20:31:25,791 - LinkedInScraper - INFO - New LinkedIn post: Been thinking about model choice for Hermes Agent and it honestly matt
2026-05-07 20:31:26,078 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent ... alternative to Open Claw ... up on ASUS DGX Sparx mac
2026-05-07 20:31:26,978 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-07 20:31:27,868 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.
2026-05-07 20:31:27,869 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-07 20:31:34,743 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-07 20:31:34,768 - GitHubScraper - INFO - Found 226 GitHub repositories for term: paperclip
2026-05-07 20:31:35,890 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-07 20:31:35,894 - GitHubScraper - INFO - Found 182 GitHub repositories for term: "Hermes Agent"
2026-05-07 20:31:36,997 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-07 20:31:37,001 - GitHubScraper - INFO - Found 40 GitHub repositories for term: multica
2026-05-07 20:31:37,145 - GitHubScraper - INFO - Total GitHub results found: 0
2026-05-07 20:31:37,146 - __main__ - INFO - Scraper reddit completed: 60 results
2026-05-07 20:31:37,146 - __main__ - INFO - Scraper github completed: 0 results
2026-05-07 20:31:37,146 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-07 20:31:37,146 - __main__ - INFO - Scraper linkedin completed: 2 results
2026-05-07 20:31:37,146 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-07 20:31:38,027 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-07 20:31:38.027652
2026-05-07 20:31:38,028 - __main__ - INFO - Email sent successfully
2026-05-07 20:31:38,028 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-07 20:31:38,028 - __main__ - INFO - Monitor complete. Found 62 total results: 60 new reddit results, 2 new linkedin results.
2026-05-07 20:31:38,028 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-07 20:31:38,028 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-07 20:31:38,231 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-07 20:31:38,231 - __main__ - INFO - Closed all database connections
2026-05-07 20:31:38,274 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-07 20:31:38,289 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-07 21:00:01,998 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-07.log
2026-05-07 21:00:01,998 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-07.log
2026-05-07 21:00:01,998 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-07.log
2026-05-07 21:00:01,999 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-07 21:00:02,022 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-07 21:00:02,022 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-07 21:00:02,024 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-07 21:00:02,025 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-07 21:00:02,040 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-07 21:00:02,040 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-07 21:00:02,041 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-07 21:00:02,042 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-07 21:00:02,042 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-07 21:00:02,045 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-07 21:00:02,045 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-07 21:00:02,045 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-07 21:00:02,048 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-07 21:00:02,053 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-07 21:00:02,053 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-07 21:00:02,055 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-07 21:00:02,055 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-07 21:00:02,055 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-07 21:00:02,055 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-07 21:00:02,055 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-07 21:00:02,056 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-07 21:00:02,150 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-07 21:00:02,154 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-07 21:00:02,154 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-07 21:00:02,155 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-07 21:00:02,569 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-07 21:00:03,053 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-07 21:00:03,623 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-07 21:00:04,479 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-07 21:00:05,606 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-07 21:00:06,485 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-07 21:00:07,655 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-07 21:00:08,484 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-07 21:00:09,651 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-07 21:00:10,491 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-07 21:00:11,609 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-07 21:00:12,492 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-07 21:00:13,638 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-07 21:00:14,181 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-07 21:00:14,493 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-07 21:00:15,636 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-07 21:00:16,497 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-07 21:00:16,756 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-07 21:00:16,982 - Yiddish24Scraper - INFO - Received response with 511047 characters
2026-05-07 21:00:16,984 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319684 chars)
2026-05-07 21:00:16,985 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-07 21:00:17,069 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-07 21:00:17,124 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-07 21:00:17,124 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-07 21:00:17,835 - Yiddish24Scraper - INFO - Page 1 summary: 8 new out of 100 total articles
2026-05-07 21:00:17,836 - Yiddish24Scraper - INFO - Page 1: 8/100 new items
2026-05-07 21:00:17,836 - Yiddish24Scraper - INFO - Low new item ratio (8.0%), stopping pagination
2026-05-07 21:00:17,837 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 8
2026-05-07 21:00:18,103 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-07 21:00:18,956 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-07 21:00:20,076 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-07 21:00:20,958 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-07 21:00:20,985 - RSSFeedScraper - INFO - Total RSS/HTML results: 22
2026-05-07 21:01:24,312 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 90 new posts.
2026-05-07 21:01:24,312 - __main__ - INFO - Scraper rss completed: 22 results
2026-05-07 21:01:24,312 - __main__ - INFO - Scraper yiddish24 completed: 8 results
2026-05-07 21:01:24,312 - __main__ - INFO - Scraper ivelt completed: 90 results
2026-05-07 21:01:25,309 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-07 21:01:25.309275
2026-05-07 21:01:25,309 - __main__ - INFO - Email sent successfully
2026-05-07 21:01:25,309 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-07 21:01:25,310 - __main__ - INFO - Monitor complete. Found 120 total results: 22 new rss results, 8 new yiddish24 results, 90 new ivelt results.
2026-05-07 21:01:25,310 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-07 21:01:25,310 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-07 21:01:25,411 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-07 21:01:25,411 - __main__ - INFO - Closed all database connections
2026-05-07 21:01:25,413 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-07 21:01:25,413 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-07 22:00:01,605 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-07.log
2026-05-07 22:00:01,605 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-07.log
2026-05-07 22:00:01,605 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-07.log
2026-05-07 22:00:01,605 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-07 22:00:01,628 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-07 22:00:01,628 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-07 22:00:01,632 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-07 22:00:01,633 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-07 22:00:01,650 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-07 22:00:01,650 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-07 22:00:01,695 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-07 22:00:01,697 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-07 22:00:01,697 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-07 22:00:01,703 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-07 22:00:01,703 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-07 22:00:01,703 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-07 22:00:01,709 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-07 22:00:01,718 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-07 22:00:01,718 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-07 22:00:01,722 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-07 22:00:01,722 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-07 22:00:01,722 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-07 22:00:01,722 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-07 22:00:01,722 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-07 22:00:01,722 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-07 22:00:01,829 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-07 22:00:01,834 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-07 22:00:01,834 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-07 22:00:01,837 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-07 22:00:02,214 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-07 22:00:02,699 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-07 22:00:03,220 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-07 22:00:03,479 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-07 22:00:03,697 - Yiddish24Scraper - INFO - Received response with 511047 characters
2026-05-07 22:00:03,701 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319684 chars)
2026-05-07 22:00:03,704 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-07 22:00:03,798 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-07 22:00:03,845 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-07 22:00:03,845 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-07 22:00:04,571 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-05-07 22:00:04,571 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-05-07 22:00:04,571 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-07 22:00:04,572 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-07 22:00:04,582 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-07 22:00:05,734 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-07 22:00:06,586 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-07 22:00:07,711 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-07 22:00:08,588 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-07 22:00:09,711 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-07 22:00:10,591 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-07 22:00:11,792 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-07 22:00:12,594 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-07 22:00:13,752 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-07 22:00:13,755 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-07 22:00:14,596 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-07 22:00:15,758 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-07 22:00:16,601 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-07 22:00:18,792 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-07 22:00:19,644 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-07 22:00:20,800 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-07 22:00:21,646 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-07 22:00:21,673 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-07 22:00:50,677 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 30 new posts.
2026-05-07 22:00:50,678 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-07 22:00:50,678 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-07 22:00:50,678 - __main__ - INFO - Scraper ivelt completed: 30 results
2026-05-07 22:00:51,525 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-07 22:00:51.525793
2026-05-07 22:00:51,526 - __main__ - INFO - Email sent successfully
2026-05-07 22:00:51,526 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-07 22:00:51,526 - __main__ - INFO - Monitor complete. Found 33 total results: 3 new rss results, 30 new ivelt results.
2026-05-07 22:00:51,526 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-07 22:00:51,526 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-07 22:00:51,650 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-07 22:00:51,650 - __main__ - INFO - Closed all database connections
2026-05-07 22:00:51,652 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-07 22:00:51,653 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-07 22:30:02,080 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-07.log
2026-05-07 22:30:02,080 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-07.log
2026-05-07 22:30:02,080 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-07.log
2026-05-07 22:30:02,080 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-07 22:30:02,104 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-07 22:30:02,104 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-07 22:30:02,104 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-07 22:30:02,106 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-07 22:30:02,107 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-07 22:30:02,125 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-07 22:30:02,125 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-07 22:30:02,126 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-07 22:30:02,126 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-07 22:30:02,126 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-07 22:30:02,126 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-07 22:30:02,127 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-07 22:30:02,127 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-07 22:30:02,127 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-07 22:30:02,129 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-07 22:30:02,129 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-07 22:30:02,132 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-07 22:30:02,136 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-07 22:30:02,136 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-07 22:30:02,138 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-07 22:30:02,138 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-07 22:30:02,139 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-07 22:30:02,139 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-07 22:30:02,139 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-07 22:30:02,139 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-07 22:30:03,013 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-07 22:30:03,054 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Seeking Recommendations for LLMs for Hermes Agent: Cost-Effective Solu
2026-05-07 22:30:04,276 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-07 22:30:04,277 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-07 22:30:04,277 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-07 22:30:04,277 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-07 22:30:05,407 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-07 22:30:05,458 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: [WTS] Special Today - Gold and Silver Jewelry - Find the 4 Pieces List
2026-05-07 22:30:06,853 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-07 22:30:06,854 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-07 22:30:06,854 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-07 22:30:06,854 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-07 22:30:07,741 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-07 22:30:08,971 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-07 22:30:08,971 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-07 22:30:08,972 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-07 22:30:08,972 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-07 22:30:09,907 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Seeking Recommendations for LLMs for Hermes Agent: Cost-Effective Solu
2026-05-07 22:30:09,918 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Hermes + Claude code Pro RIP?
2026-05-07 22:30:11,151 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-07 22:30:13,236 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-07 22:30:14,430 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/islamichistory: Mughal India: Temple Desecration & Historical Myths: What the Records
2026-05-07 22:30:15,647 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-07 22:30:17,517 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-07 22:30:17,517 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-07 22:30:19,961 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-07 22:30:21,968 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-07 22:30:23,897 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/ClaudeCode+ClaudeAI+claude+vibecoding (limit=25)
2026-05-07 22:30:23,897 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude agent via RSS
2026-05-07 22:30:24,839 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Optimized Claude Code Subagent Workflow for Project Managem
2026-05-07 22:30:24,849 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Efficiently Manage Multiple Claude Code Sessions with Git W
2026-05-07 22:30:24,861 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Claude Code Skill: Linus Level Strictness Dial for Adaptive
2026-05-07 22:30:24,872 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Iterative AI-driven Code Review and Architectural Decision
2026-05-07 22:30:24,884 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Integrate `groxide` as a Claude Code Skill for Direct Rust
2026-05-07 22:30:24,895 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Advanced Claude Prompt for Generating Validated, Phased Ref
2026-05-07 22:30:24,907 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] GStack Framework: A 7-Step Process for High-Velocity AI-Ass
2026-05-07 22:30:24,918 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Claude Code Spellbook: Toolkit for Enhanced Code Quality, F
2026-05-07 22:30:24,927 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/codex: How to Transfer from Claude Code to Codex?
2026-05-07 22:30:24,941 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/codex: 711k saved today. Thx colony
2026-05-07 22:30:24,950 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AI_Agents: Do you have examples of tasks Codex could do but Claude Code couldn't
2026-05-07 22:30:24,964 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCodeSEO: 5 MCP servers replacing half my SEO stack — what's actually in my Clau
2026-05-07 22:30:24,973 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AgenticCareers: 👋 Welcome to r/AgenticCareers - Introduce Yourself and Read First!
2026-05-07 22:30:24,983 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AiAutomations: Facebook/ Instagram scraping
2026-05-07 22:30:24,994 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/SiliconValleyBayArea: How Sakana trained a 7B model to orchestrate GPT-5, Claude Sonnet 4 an
2026-05-07 22:30:25,007 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/jobhuntify: Remote Job - Coupa Software - Sr. Lead AI Engineer - 11509
2026-05-07 22:30:25,018 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/jobhuntify: Remote Job - Coupa Software - Lead AI Engineer
2026-05-07 22:30:25,030 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/monocle2ai: Meetup for AI Builders in Minneapolis
2026-05-07 22:30:25,041 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_EfficiencyNo6200: Coding, autism and adhd. Please help me!
2026-05-07 22:30:25,056 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/obs: @unngh/obs-mcp - Control OBS Studio with AI agents, now available as a
2026-05-07 22:30:25,067 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ValueInvesting: Brad Gerstner on the Economy of AI Supercycle - Inference, Infrastruct
2026-05-07 22:30:25,075 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/FunMachineLearning: I built a tool that shows Phi-3.5 charges 2.27× more tokens than Qwen2
2026-05-07 22:30:26,076 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude code agent via RSS
2026-05-07 22:30:27,025 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Custom Claude Code Status Line for Git, PR, Context, and Qu
2026-05-07 22:30:27,035 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/github: My Claude dreams at night and remembers everything. Better than mempal
2026-05-07 22:30:27,045 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AiBuilders: Is anyone else frustrated by the amount of "Token Waste" in current MA
2026-05-07 22:30:27,058 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AI_Agents: Smarter AI agents do not mean better AI agents
2026-05-07 22:30:27,072 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: 6 months building Cost Share with Claude — shipped to App Store. Here'
2026-05-07 22:30:27,088 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/GenAiApps: SarahMemory AiOS
2026-05-07 22:30:27,097 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: Vibe code Apps with a Voice Agents, looking for feedback.
2026-05-07 22:30:27,108 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: Exportal - Claude Ai/Design to VS Code
2026-05-07 22:30:27,118 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Monitoring: Monitoring Platform Feedback Please
2026-05-07 22:30:27,128 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/commandline: Workdash, a dashboard for the development tools you already use
2026-05-07 22:30:27,140 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/webdev: I just built my website with little coding experience
2026-05-07 22:30:28,140 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: AI coding agent via RSS
2026-05-07 22:30:29,064 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ShowMeYourSaaS: Pitch your SaaS in one sentence, then show what you’re improving.
2026-05-07 22:30:29,074 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/BabyNames: I built a baby name app for couples after looking at why every existin
2026-05-07 22:30:29,082 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Soundhound: Why I'm adding more to my portfolio:
2026-05-07 22:30:29,093 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/PubTips: [QCrit] HORIZONFALL - Adult Fantasy, 115k (3rd Attempt)
2026-05-07 22:30:29,105 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/codex: From old prototype to full script-to-audio studio — rebuilt entirely w
2026-05-07 22:30:30,105 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-07 22:30:32,105 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 41
2026-05-07 22:30:32,106 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-07 22:30:32,228 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-07 22:30:32,672 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-07 22:30:46,525 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-07 22:31:00,612 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-07 22:31:14,353 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-07 22:31:14,353 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-07 22:31:14,886 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-07 22:31:14,984 - LinkedInScraper - INFO - New LinkedIn post: Met up with a founder friend and we started talking about building aut
2026-05-07 22:31:16,165 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-07 22:31:16,275 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent has 137K stars on Github: https://lnkd.in/gfxP3e-R Sounds
2026-05-07 22:31:17,462 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-07 22:31:17,827 - LinkedInScraper - INFO - New LinkedIn post: Vibe Before You Buy! - PentesterLab's Blog - LinkedIn
2026-05-07 22:31:18,261 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 3 new results.
2026-05-07 22:31:18,262 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-07 22:31:24,015 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-07 22:31:24,040 - GitHubScraper - INFO - Found 226 GitHub repositories for term: paperclip
2026-05-07 22:31:24,120 - GitHubScraper - INFO - Added new GitHub repository: agent-teams-ai
2026-05-07 22:31:25,133 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-07 22:31:25,228 - GitHubScraper - INFO - Found 182 GitHub repositories for term: "Hermes Agent"
2026-05-07 22:31:26,305 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-07 22:31:26,307 - GitHubScraper - INFO - Found 40 GitHub repositories for term: multica
2026-05-07 22:31:26,452 - GitHubScraper - INFO - Total GitHub results found: 1
2026-05-07 22:31:26,452 - __main__ - INFO - Scraper reddit completed: 43 results
2026-05-07 22:31:26,452 - __main__ - INFO - Scraper github completed: 1 results
2026-05-07 22:31:26,452 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-07 22:31:26,452 - __main__ - INFO - Scraper linkedin completed: 3 results
2026-05-07 22:31:26,452 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-07 22:31:27,161 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-07 22:31:27.161638
2026-05-07 22:31:27,161 - __main__ - INFO - Email sent successfully
2026-05-07 22:31:27,162 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-07 22:31:27,162 - __main__ - INFO - Monitor complete. Found 47 total results: 43 new reddit results, 1 new github results, 3 new linkedin results.
2026-05-07 22:31:27,162 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-07 22:31:27,162 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-07 22:31:27,380 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-07 22:31:27,381 - __main__ - INFO - Closed all database connections
2026-05-07 22:31:27,423 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-07 22:31:27,439 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-07 23:00:02,295 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-07.log
2026-05-07 23:00:02,295 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-07.log
2026-05-07 23:00:02,295 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-07.log
2026-05-07 23:00:02,295 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-07 23:00:02,318 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-07 23:00:02,318 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-07 23:00:02,320 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-07 23:00:02,321 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-07 23:00:02,340 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-07 23:00:02,340 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-07 23:00:02,379 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-07 23:00:02,380 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-07 23:00:02,380 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-07 23:00:02,383 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-07 23:00:02,383 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-07 23:00:02,384 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-07 23:00:02,386 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-07 23:00:02,390 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-07 23:00:02,390 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-07 23:00:02,393 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-07 23:00:02,393 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-07 23:00:02,393 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-07 23:00:02,393 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-07 23:00:02,393 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-07 23:00:02,393 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-07 23:00:02,499 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-07 23:00:02,503 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-07 23:00:02,503 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-07 23:00:02,506 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-07 23:00:02,844 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-07 23:00:03,708 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-07 23:00:04,266 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-07 23:00:05,104 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-07 23:00:06,228 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-07 23:00:07,107 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-07 23:00:08,259 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-07 23:00:09,113 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-07 23:00:10,255 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-07 23:00:11,118 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-07 23:00:12,244 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-07 23:00:12,269 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-07 23:00:12,468 - Yiddish24Scraper - INFO - Received response with 518861 characters
2026-05-07 23:00:12,472 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (322528 chars)
2026-05-07 23:00:12,476 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-07 23:00:12,556 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-07 23:00:12,596 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-07 23:00:12,596 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-07 23:00:13,440 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 100 total articles
2026-05-07 23:00:13,440 - Yiddish24Scraper - INFO - Page 1: 11/100 new items
2026-05-07 23:00:13,440 - Yiddish24Scraper - INFO - Low new item ratio (11.0%), stopping pagination
2026-05-07 23:00:13,440 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-05-07 23:00:13,450 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-07 23:00:14,569 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-07 23:00:14,574 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-07 23:00:15,453 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-07 23:00:16,588 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-07 23:00:17,455 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-07 23:00:18,715 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-07 23:00:19,456 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-07 23:00:20,592 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-07 23:00:21,460 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-07 23:00:21,487 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-05-07 23:00:50,990 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 16 new posts.
2026-05-07 23:00:50,990 - __main__ - INFO - Scraper rss completed: 4 results
2026-05-07 23:00:50,990 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-05-07 23:00:50,991 - __main__ - INFO - Scraper ivelt completed: 16 results
2026-05-07 23:00:51,807 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-07 23:00:51.807466
2026-05-07 23:00:51,807 - __main__ - INFO - Email sent successfully
2026-05-07 23:00:51,808 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-07 23:00:51,808 - __main__ - INFO - Monitor complete. Found 31 total results: 4 new rss results, 11 new yiddish24 results, 16 new ivelt results.
2026-05-07 23:00:51,808 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-07 23:00:51,808 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-07 23:00:51,886 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-07 23:00:51,887 - __main__ - INFO - Closed all database connections
2026-05-07 23:00:51,889 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-07 23:00:51,889 - social_media_monitor.database.connection - INFO - Closed 0 database connections