Crawl4AI
Free
Open-source, LLM-friendly web crawler and scraper
Web Scraper
Open-Source
RAG
Open-source, LLM-ready web crawler and scraper that turns pages into clean Markdown, supports CSS/XPath/LLM extraction, adaptive crawling, stealth browser control, PDF parsing, and high-performance async crawling—ideal for RAG, agents, and data pipelines.
