vllm joeynyc · PARTIAL
A high-throughput and memory-efficient inference and serving engine for LLMs
github.com/joeynyc/vllm · ★ 0 · Forks 0 · Size 230.0 MB
SUMMARY
Technologies 37
Scored 34
Observed 34
Practices 6
Evidence 51
Skips 3
COVERAGE
Analyzed 5847 files · 20823 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
C++ LANGUAGE Depth 70
118 files · PRODUCTION
Shell LANGUAGE Depth 70
115 files · PRODUCTION
Rust LANGUAGE Depth 70
247 files · PRODUCTION
JavaScript LANGUAGE Depth 70
6 files · PRODUCTION
JSON LANGUAGE Depth 70
621 files · PRODUCTION
Markdown LANGUAGE Depth 70
284 files · PRODUCTION
TOML LANGUAGE Depth 70
19 files · PRODUCTION
YAML LANGUAGE Depth 70
280 files · PRODUCTION
Python LANGUAGE Depth 70
3685 files · PRODUCTION
Cargo BUILD_TOOL Depth 80
1 files · CONFIGURATION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
AWS SDK CLOUD Depth 58
1 files · PRODUCTION
Axum FRAMEWORK Depth 74
34 files · PRODUCTION
Bytes LIBRARY Depth 74
5 files · PRODUCTION
Clap LIBRARY Depth —
0 files · config only
FastAPI FRAMEWORK Depth 81
84 files · PRODUCTION, TEST
Jinja2 LIBRARY Depth 81
6 files · PRODUCTION, TEST
Next.js FRAMEWORK Depth 58
1 files · PRODUCTION
NumPy LIBRARY Depth 100
289 files · CONFIGURATION, PRODUCTION, TEST
Pydantic LIBRARY Depth 100
77 files · CONFIGURATION, PRODUCTION, TEST
Redis CACHE Depth 84
5 files · CONFIGURATION
Requests LIBRARY Depth 81
93 files · PRODUCTION, TEST
Reqwest LIBRARY Depth —
0 files · config only
Serde LIBRARY Depth 74
49 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 74
14 files · PRODUCTION
Tokio LIBRARY Depth 74
43 files · PRODUCTION, TEST
Tokio Stream LIBRARY Depth 58
1 files · PRODUCTION
Tokio Util LIBRARY Depth 74
12 files · PRODUCTION
Tracing OBSERVABILITY Depth —
0 files · config only
TypeScript LANGUAGE Depth 100
329 files · CONFIGURATION, PRODUCTION, TEST
Uvicorn LIBRARY Depth 81
13 files · PRODUCTION, TEST
lxml LIBRARY Depth 58
1 files · PRODUCTION
orjson LIBRARY Depth 58
1 files · PRODUCTION
pandas LIBRARY Depth 85
23 files · PRODUCTION, TEST
pytest TESTING Depth 81
1097 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-02-09
Last commit 2026-07-07
Active months 42
Commits 20823