- Added a new scheduler module to manage periodic jobs for recruitment data processing.
- Created a search_company_graph module to handle the logic for searching company recruitment pages.
- Implemented nodes for searching, extracting links, verifying recruitment lists, and navigating to recruitment pages.
- Developed prompts for LLM to guide the extraction and verification processes.
- Added state management for tracking the search process and results.
- Created a test script for crawling job listings from various company websites.
kgod