crawl4ai unclecode · PARTIAL
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
github.com/unclecode/crawl4ai · ★ 85381 · Forks 8866 · Size 148.0 MB
SUMMARY
Technologies 29
Scored 26
Observed 26
Practices 6
Evidence 31
Skips 3
COVERAGE
Analyzed 946 files · 1998 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Shell LANGUAGE Depth 70
3 files · PRODUCTION
JavaScript LANGUAGE Depth 70
48 files · PRODUCTION
JSON LANGUAGE Depth 70
11 files · PRODUCTION
Markdown LANGUAGE Depth 70
158 files · PRODUCTION
TOML LANGUAGE Depth 70
2 files · PRODUCTION
YAML LANGUAGE Depth 70
16 files · PRODUCTION
Python LANGUAGE Depth 70
497 files · PRODUCTION
uv BUILD_TOOL Depth 80
1 files · CONFIGURATION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
Click LIBRARY Depth 78
6 files · PRODUCTION, TEST
FastAPI FRAMEWORK Depth 78
11 files · PRODUCTION, TEST
Flask FRAMEWORK Depth 37
1 files · TEST
HTTPX LIBRARY Depth —
0 files · config only
NumPy LIBRARY Depth 78
10 files · PRODUCTION, TEST
Playwright LIBRARY Depth 78
9 files · PRODUCTION, TEST
Pydantic LIBRARY Depth 81
12 files · PRODUCTION, TEST
Redis CACHE Depth 93
8 files · CONFIGURATION, PRODUCTION
Requests LIBRARY Depth 81
24 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 78
5 files · PRODUCTION, TEST
TypeScript LANGUAGE Depth 70
4 files · PRODUCTION
Uvicorn LIBRARY Depth 58
1 files · PRODUCTION
cssselect LIBRARY Depth —
0 files · config only
curl_cffi LIBRARY Depth 37
1 files · TEST
lxml LIBRARY Depth 78
13 files · PRODUCTION, TEST
pandas LIBRARY Depth 58
1 files · PRODUCTION
pytest TESTING Depth 78
127 files · PRODUCTION, TEST
python-dotenv LIBRARY Depth —
0 files · config only
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2024-05-09
Last commit 2026-10-13
Active months 30
Commits 1998