scrapeforge cemdrk · PARTIAL
Schema-driven web scraping for Python: a URL and a Pydantic model in, a validated instance out. Layered anti-bot evasion, provider-agnostic LLM extraction, and link discovery from robots.txt, sitemap.xml, llms.txt and ai.txt.
github.com/cemdrk/scrapeforge · ★ 1 · Forks 0 · Size 259 KB
SUMMARY
Technologies 15
Scored 13
Observed 13
Practices 6
Evidence 16
Skips 2
COVERAGE
Analyzed 75 files · 13 commits · 0 API calls
TECHNOLOGIES & DEPTH
JSON LANGUAGE Depth 70
1 files · PRODUCTION
Markdown LANGUAGE Depth 70
5 files · PRODUCTION
TOML LANGUAGE Depth 70
1 files · PRODUCTION
XML LANGUAGE Depth 70
3 files · PRODUCTION
YAML LANGUAGE Depth 70
5 files · PRODUCTION
Python LANGUAGE Depth 70
52 files · PRODUCTION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
HTTPX LIBRARY Depth —
0 files · config only
Playwright LIBRARY Depth 70
3 files · PRODUCTION, TEST
Pydantic LIBRARY Depth 81
11 files · PRODUCTION, TEST
Requests LIBRARY Depth 58
1 files · PRODUCTION
Ruff QUALITY Depth —
0 files · config only
TypeScript LANGUAGE Depth 58
1 files · PRODUCTION
curl_cffi LIBRARY Depth 58
1 files · PRODUCTION
pytest TESTING Depth 74
14 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · absentlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2026-08-12
Last commit 2026-08-12
Active months 1
Commits 13