vllm BoxiYu · COMPLETED
A high-throughput and memory-efficient inference and serving engine for LLMs
github.com/BoxiYu/vllm · ★ 0 · Forks 0 · Size 195.8 MB
SUMMARY
Technologies 24
Scored 24
Observed 24
Practices 6
Evidence 25
Skips 0
COVERAGE
Analyzed 4838 files · 16390 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
C++ LANGUAGE Depth 70
111 files · PRODUCTION
Shell LANGUAGE Depth 70
105 files · PRODUCTION
JavaScript LANGUAGE Depth 70
6 files · PRODUCTION
JSON LANGUAGE Depth 70
578 files · PRODUCTION
Markdown LANGUAGE Depth 70
260 files · PRODUCTION
TOML LANGUAGE Depth 70
2 files · PRODUCTION
YAML LANGUAGE Depth 70
225 files · PRODUCTION
Python LANGUAGE Depth 70
3136 files · PRODUCTION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
AWS SDK CLOUD Depth 58
1 files · PRODUCTION
FastAPI FRAMEWORK Depth 81
71 files · PRODUCTION, TEST
Jinja2 LIBRARY Depth 81
5 files · PRODUCTION, TEST
NumPy LIBRARY Depth 100
254 files · CONFIGURATION, PRODUCTION, TEST
Pydantic LIBRARY Depth 100
70 files · CONFIGURATION, PRODUCTION, TEST
Redis CACHE Depth 80
4 files · CONFIGURATION
Requests LIBRARY Depth 81
88 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 74
15 files · PRODUCTION
TypeScript LANGUAGE Depth 100
255 files · CONFIGURATION, PRODUCTION, TEST
Uvicorn LIBRARY Depth 81
9 files · PRODUCTION
orjson LIBRARY Depth 58
1 files · PRODUCTION
pandas LIBRARY Depth 85
24 files · PRODUCTION, TEST
pytest TESTING Depth 78
916 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-02-09
Last commit 2026-05-07
Active months 40
Commits 16390