crawlee-python MostlyKIGuess · PARTIAL
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
github.com/MostlyKIGuess/crawlee-python · ★ 1 · Forks 0 · Size 24.3 MB
SUMMARY
Technologies 24
Scored 19
Observed 19
Practices 6
Evidence 25
Skips 5
COVERAGE
Analyzed 412 files · 435 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
2 files · PRODUCTION
Shell LANGUAGE Depth 70
2 files · PRODUCTION
JavaScript LANGUAGE Depth 70
28 files · PRODUCTION
JSON LANGUAGE Depth 70
7 files · PRODUCTION
Markdown LANGUAGE Depth 70
36 files · PRODUCTION
TOML LANGUAGE Depth 70
4 files · PRODUCTION
YAML LANGUAGE Depth 70
15 files · PRODUCTION
Python LANGUAGE Depth 70
226 files · PRODUCTION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
npm BUILD_TOOL Depth 80
1 files · CONFIGURATION
Yarn BUILD_TOOL Depth 80
1 files · CONFIGURATION
ESLint QUALITY Depth 73
3 files · CONFIGURATION
HTTPX LIBRARY Depth —
0 files · config only
Playwright LIBRARY Depth 78
7 files · PRODUCTION, TEST
Prettier QUALITY Depth 69
2 files · CONFIGURATION
Pydantic LIBRARY Depth 78
16 files · PRODUCTION, TEST
React FRAMEWORK Depth 74
19 files · PRODUCTION
Ruff QUALITY Depth —
0 files · config only
TypeScript LANGUAGE Depth 66
3 files · PRODUCTION
curl_cffi LIBRARY Depth 58
1 files · PRODUCTION
lxml LIBRARY Depth —
0 files · config only
mypy QUALITY Depth —
0 files · config only
pytest TESTING Depth 74
45 files · PRODUCTION, TEST
typing_extensions LIBRARY Depth —
0 files · config only
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · observed
ACTIVITY & OWNERSHIP
First commit 2024-01-10
Last commit 2024-10-12
Active months 10
Commits 435