vllm vllm-project · PARTIAL
A high-throughput and memory-efficient inference and serving engine for LLMs
github.com/vllm-project/vllm · ★ 93765 · Forks 23370 · Size 310.9 MB
SUMMARY
Technologies 37
Scored 33
Observed 33
Practices 6
Evidence 54
Skips 4
COVERAGE
Analyzed 7746 files · 25673 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Shell LANGUAGE Depth 70
137 files · PRODUCTION
C++ LANGUAGE Depth 70
139 files · PRODUCTION
Rust LANGUAGE Depth 70
357 files · PRODUCTION
JavaScript LANGUAGE Depth 70
7 files · PRODUCTION
JSON LANGUAGE Depth 70
713 files · PRODUCTION
TOML LANGUAGE Depth 70
24 files · PRODUCTION
Markdown LANGUAGE Depth 70
321 files · PRODUCTION
YAML LANGUAGE Depth 70
358 files · PRODUCTION
Python LANGUAGE Depth 70
5113 files · PRODUCTION
Cargo BUILD_TOOL Depth 80
1 files · CONFIGURATION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
AWS SDK CLOUD Depth 58
1 files · PRODUCTION
Axum FRAMEWORK Depth 74
38 files · PRODUCTION
Bytes LIBRARY Depth 74
12 files · PRODUCTION
Clap LIBRARY Depth —
0 files · config only
FastAPI FRAMEWORK Depth 81
122 files · PRODUCTION, TEST
Jinja2 LIBRARY Depth 81
6 files · PRODUCTION, TEST
Next.js FRAMEWORK Depth 58
1 files · PRODUCTION
NumPy LIBRARY Depth 100
402 files · CONFIGURATION, PRODUCTION, TEST
Pydantic LIBRARY Depth 100
112 files · CONFIGURATION, PRODUCTION, TEST
Redis CACHE Depth 84
6 files · CONFIGURATION
Requests LIBRARY Depth 81
108 files · PRODUCTION, TEST
Reqwest LIBRARY Depth —
0 files · config only
Serde LIBRARY Depth 74
71 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 78
31 files · PRODUCTION, TEST
Tokio LIBRARY Depth 74
58 files · PRODUCTION, TEST
Tokio Stream LIBRARY Depth —
0 files · config only
Tokio Util LIBRARY Depth 74
15 files · PRODUCTION
Tracing OBSERVABILITY Depth —
0 files · config only
TypeScript LANGUAGE Depth 100
483 files · CONFIGURATION, PRODUCTION, TEST, TOOLING
Uvicorn LIBRARY Depth 81
16 files · PRODUCTION, TEST
lxml LIBRARY Depth 58
1 files · PRODUCTION
orjson LIBRARY Depth 58
1 files · PRODUCTION
pandas LIBRARY Depth 85
26 files · PRODUCTION, TEST
pytest TESTING Depth 81
1665 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-02-09
Last commit 2026-10-14
Active months 45
Commits 25673