vllm xxnuo · PARTIAL
A high-throughput and memory-efficient inference and serving engine for LLMs
github.com/xxnuo/vllm · ★ 0 · Forks 0 · Size 257.5 MB
SUMMARY
Technologies 37
Scored 34
Observed 34
Practices 6
Evidence 53
Skips 3
COVERAGE
Analyzed 6578 files · 22801 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
C++ LANGUAGE Depth 70
126 files · PRODUCTION
Shell LANGUAGE Depth 70
131 files · PRODUCTION
Rust LANGUAGE Depth 70
304 files · PRODUCTION
JavaScript LANGUAGE Depth 70
7 files · PRODUCTION
JSON LANGUAGE Depth 70
649 files · PRODUCTION
TOML LANGUAGE Depth 70
22 files · PRODUCTION
Markdown LANGUAGE Depth 70
282 files · PRODUCTION
YAML LANGUAGE Depth 70
312 files · PRODUCTION
Python LANGUAGE Depth 70
4226 files · PRODUCTION
Cargo BUILD_TOOL Depth 80
1 files · CONFIGURATION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
AWS SDK CLOUD Depth 58
1 files · PRODUCTION
Axum FRAMEWORK Depth 74
35 files · PRODUCTION
Bytes LIBRARY Depth 74
9 files · PRODUCTION
Clap LIBRARY Depth —
0 files · config only
FastAPI FRAMEWORK Depth 81
98 files · PRODUCTION, TEST
Jinja2 LIBRARY Depth 81
6 files · PRODUCTION, TEST
Next.js FRAMEWORK Depth 58
1 files · PRODUCTION
NumPy LIBRARY Depth 100
324 files · CONFIGURATION, PRODUCTION, TEST
Pydantic LIBRARY Depth 100
86 files · CONFIGURATION, PRODUCTION, TEST
Redis CACHE Depth 84
5 files · CONFIGURATION
Requests LIBRARY Depth 81
97 files · PRODUCTION, TEST
Reqwest LIBRARY Depth —
0 files · config only
Serde LIBRARY Depth 74
53 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 78
22 files · PRODUCTION, TEST
Tokio LIBRARY Depth 74
52 files · PRODUCTION, TEST
Tokio Stream LIBRARY Depth 58
1 files · PRODUCTION
Tokio Util LIBRARY Depth 74
14 files · PRODUCTION
Tracing OBSERVABILITY Depth —
0 files · config only
TypeScript LANGUAGE Depth 100
376 files · CONFIGURATION, PRODUCTION, TEST, TOOLING
Uvicorn LIBRARY Depth 81
13 files · PRODUCTION, TEST
lxml LIBRARY Depth 58
1 files · PRODUCTION
orjson LIBRARY Depth 58
1 files · PRODUCTION
pandas LIBRARY Depth 85
24 files · PRODUCTION, TEST
pytest TESTING Depth 81
1298 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-02-09
Last commit 2026-08-27
Active months 43
Commits 22801