upstreaming-to-vllm JF-D · COMPLETED
A high-throughput and memory-efficient inference and serving engine for LLMs
github.com/JF-D/upstreaming-to-vllm · ★ 0 · Forks 0 · Size 18.6 MB
SUMMARY
Technologies 20
Scored 20
Observed 20
Practices 6
Evidence 21
Skips 0
COVERAGE
Analyzed 1083 files · 3068 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Shell LANGUAGE Depth 70
28 files · PRODUCTION
C++ LANGUAGE Depth 70
34 files · PRODUCTION
JavaScript LANGUAGE Depth 70
2 files · PRODUCTION
JSON LANGUAGE Depth 70
60 files · PRODUCTION
TOML LANGUAGE Depth 70
1 files · PRODUCTION
Markdown LANGUAGE Depth 70
20 files · PRODUCTION
YAML LANGUAGE Depth 70
46 files · PRODUCTION
Python LANGUAGE Depth 70
696 files · PRODUCTION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
FastAPI FRAMEWORK Depth 78
7 files · PRODUCTION
Jinja2 LIBRARY Depth 58
1 files · PRODUCTION
NumPy LIBRARY Depth 85
36 files · PRODUCTION, TEST
Pydantic LIBRARY Depth 74
10 files · PRODUCTION
Requests LIBRARY Depth 81
12 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 58
1 files · PRODUCTION
TypeScript LANGUAGE Depth 81
29 files · PRODUCTION, TEST
Uvicorn LIBRARY Depth 66
2 files · PRODUCTION
pandas LIBRARY Depth 74
4 files · PRODUCTION
pytest TESTING Depth 74
193 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-02-09
Last commit 2025-01-24
Active months 22
Commits 3068