Skip to content

All pages

Crawl4AI

Open-source, LLM-friendly web crawler and scraper

AI18d ago
Category
AI
Website
github.com
Language
English
Listed
18d ago
Forks
8,664

unclecode/crawl4ai ↗, Python, Apache-2.0, Last commit 2d ago

Crawl4AI is an open-source web crawler and scraper built for LLM pipelines. It fetches pages and returns them as clean, structured Markdown that language models can consume directly, and its Python API handles everything from a single URL to large asynchronous crawls.

Like this product?