crawlee-python crypto318 · PARTIAL
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
github.com/crypto318/crawlee-python · ★ 1 · Forks 0 · Size 34.0 MB
SUMMARY
Technologies 32
Scored 28
Observed 28
Practices 6
Evidence 33
Skips 4
COVERAGE
Analyzed 707 files · 1271 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Shell LANGUAGE Depth 70
1 files · PRODUCTION
JavaScript LANGUAGE Depth 70
39 files · PRODUCTION
JSON LANGUAGE Depth 70
6 files · PRODUCTION
Markdown LANGUAGE Depth 70
65 files · PRODUCTION
TOML LANGUAGE Depth 70
4 files · PRODUCTION
YAML LANGUAGE Depth 70
12 files · PRODUCTION
Python LANGUAGE Depth 70
431 files · PRODUCTION
uv BUILD_TOOL Depth 80
1 files · CONFIGURATION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
npm BUILD_TOOL Depth 80
1 files · CONFIGURATION
Yarn BUILD_TOOL Depth 80
1 files · CONFIGURATION
BrowserForge LIBRARY Depth 78
5 files · PRODUCTION, TEST
Click LIBRARY Depth 58
1 files · PRODUCTION
ESLint QUALITY Depth 73
3 files · CONFIGURATION
HTTPX LIBRARY Depth —
0 files · config only
NumPy LIBRARY Depth 48
1 files · PRODUCTION
Playwright LIBRARY Depth 78
15 files · PRODUCTION, TEST
PostgreSQL DATABASE Depth —
0 files · config only
Prettier QUALITY Depth 69
2 files · CONFIGURATION
Pydantic LIBRARY Depth 78
25 files · PRODUCTION, TEST
React FRAMEWORK Depth 74
28 files · PRODUCTION
Redis CACHE Depth 93
11 files · CONFIGURATION, PRODUCTION
SQLAlchemy LIBRARY Depth 78
9 files · PRODUCTION, TEST
TypeScript LANGUAGE Depth 74
17 files · PRODUCTION
Uvicorn LIBRARY Depth 62
2 files · PRODUCTION
apify-fingerprint LIBRARY Depth —
0 files · config only
curl_cffi LIBRARY Depth 70
3 files · PRODUCTION, TEST
debug LIBRARY Depth 50
1 files · PRODUCTION
pytest TESTING Depth 74
61 files · PRODUCTION, TEST
typing_extensions LIBRARY Depth —
0 files · config only
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · observed
ACTIVITY & OWNERSHIP
First commit 2024-01-10
Last commit 2025-12-18
Active months 24
Commits 1271