crawlee-python anxkhn · PARTIAL
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
github.com/anxkhn/crawlee-python · ★ 0 · Forks 0 · Size 41.6 MB
SUMMARY
Technologies 37
Scored 33
Observed 33
Practices 6
Evidence 38
Skips 4
COVERAGE
Analyzed 1187 files · 1998 commits · 0 API calls
TECHNOLOGIES & DEPTH
TypeScript LANGUAGE Depth 70
1 files · PRODUCTION
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Shell LANGUAGE Depth 70
1 files · PRODUCTION
JavaScript LANGUAGE Depth 70
40 files · PRODUCTION
JSON LANGUAGE Depth 70
12 files · PRODUCTION
Markdown LANGUAGE Depth 70
182 files · PRODUCTION
TOML LANGUAGE Depth 70
4 files · PRODUCTION
YAML LANGUAGE Depth 70
14 files · PRODUCTION
Python LANGUAGE Depth 70
783 files · PRODUCTION
uv BUILD_TOOL Depth 80
1 files · CONFIGURATION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
npm BUILD_TOOL Depth 80
1 files · CONFIGURATION
pnpm BUILD_TOOL Depth 80
1 files · CONFIGURATION
BrowserForge LIBRARY Depth 74
4 files · PRODUCTION, TEST
Click LIBRARY Depth 58
1 files · PRODUCTION
ESLint QUALITY Depth 65
1 files · CONFIGURATION
FastAPI FRAMEWORK Depth 70
4 files · PRODUCTION
Flask FRAMEWORK Depth 62
2 files · PRODUCTION
HTTPX LIBRARY Depth —
0 files · config only
Next.js FRAMEWORK Depth 62
2 files · PRODUCTION
NumPy LIBRARY Depth 48
1 files · PRODUCTION
Playwright LIBRARY Depth 81
26 files · PRODUCTION, TEST
PostgreSQL DATABASE Depth —
0 files · config only
Pydantic LIBRARY Depth 81
32 files · PRODUCTION, TEST
RabbitMQ MESSAGE_BROKER Depth 65
1 files · CONFIGURATION
React FRAMEWORK Depth 74
30 files · PRODUCTION
Redis CACHE Depth 100
15 files · CONFIGURATION, PRODUCTION, TEST
SQLAlchemy LIBRARY Depth 81
11 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 62
2 files · PRODUCTION
Uvicorn LIBRARY Depth 74
4 files · PRODUCTION
apify-fingerprint LIBRARY Depth —
0 files · config only
curl_cffi LIBRARY Depth 70
3 files · PRODUCTION, TEST
debug LIBRARY Depth 50
1 files · PRODUCTION
lxml LIBRARY Depth 62
2 files · PRODUCTION
pytest TESTING Depth 74
74 files · PRODUCTION, TEST
typing_extensions LIBRARY Depth —
0 files · config only
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · observed
ACTIVITY & OWNERSHIP
First commit 2024-01-10
Last commit 2026-08-14
Active months 32
Commits 1998