post_crawler

Author	SHA1	Message	Date
kgod	45762101bc	chore: remove legacy code, keep only crawl directory	2026-05-28 00:04:05 +08:00
kgod	c06f595559	feat: add crawl scripts for recruitment websites - btyy (倍特药业), fullsemi (富芯半导体): 北森平台爬虫 - hotjob (中国五矿): hotjob平台爬虫 - leinao (中科类脑): 静态HTML爬虫 - task_fetcher: 原子锁获取任务 - post.md: 抓取技能文档 - export_har: mitmproxy HAR导出工具	2026-05-27 23:48:30 +08:00
kgod	2e9efce291	update .gitignore	2026-05-27 09:53:20 +08:00
kgod	e24e4806bf	merge local changes	2026-05-26 21:10:52 +08:00
kgod	b3f35dbdea	feat: Implement job scheduling and company recruitment search functionality - Added a new scheduler module to manage periodic jobs for recruitment data processing. - Created a search_company_graph module to handle the logic for searching company recruitment pages. - Implemented nodes for searching, extracting links, verifying recruitment lists, and navigating to recruitment pages. - Developed prompts for LLM to guide the extraction and verification processes. - Added state management for tracking the search process and results. - Created a test script for crawling job listings from various company websites.	2026-05-26 21:03:24 +08:00
kgod	8697477a53	提交	2026-05-26 21:02:17 +08:00
offerpai	287ec85a38	Initial commit	2026-05-26 12:43:29 +00:00