LLMWebCrawler cemdrk · PARTIAL
A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval
github.com/cemdrk/LLMWebCrawler · ★ 2 · Forks 0 · Size 21 KB
SUMMARY
Technologies 9
Scored 8
Observed 8
Practices 6
Evidence 10
Skips 1
COVERAGE
Analyzed 26 files · 9 commits · 0 API calls
TECHNOLOGIES & DEPTH
Shell LANGUAGE Depth 70
1 files · PRODUCTION
Markdown LANGUAGE Depth 70
1 files · PRODUCTION
YAML LANGUAGE Depth 70
2 files · PRODUCTION
Python LANGUAGE Depth 70
20 files · PRODUCTION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
FastAPI FRAMEWORK Depth 44
1 files · PRODUCTION
Pydantic LIBRARY Depth 40
1 files · PRODUCTION
Requests LIBRARY Depth 50
1 files · PRODUCTION
Uvicorn LIBRARY Depth —
0 files · config only
PRACTICES
documentation · observedautomated_tests · absentcontinuous_integration · absentcontainerization · absentlinting · absentformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-09-28
Last commit 2023-10-15
Active months 2
Commits 9