llmstream realsigridjin · PARTIAL
A scalable and efficient REST API for load-balanced LLM inference across multiple servers.
github.com/realsigridjin/llmstream · ★ 0 · Forks 0 · Size 20 KB
SUMMARY
Technologies 8
Scored 6
Observed 6
Practices 6
Evidence 9
Skips 2
COVERAGE
Analyzed 17 files · 7 commits · 0 API calls
TECHNOLOGIES & DEPTH
Markdown LANGUAGE Depth 70
1 files · PRODUCTION
JSON LANGUAGE Depth 70
1 files · PRODUCTION
Python LANGUAGE Depth 70
14 files · PRODUCTION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
FastAPI FRAMEWORK Depth 70
4 files · PRODUCTION
HTTPX LIBRARY Depth —
0 files · config only
Pydantic LIBRARY Depth 45
1 files · PRODUCTION
Uvicorn LIBRARY Depth —
0 files · config only
PRACTICES
documentation · observedautomated_tests · absentcontinuous_integration · absentcontainerization · absentlinting · absentformatting · absent
ACTIVITY & OWNERSHIP
First commit 2024-12-18
Last commit 2024-12-18
Active months 1
Commits 7