vllm tmimmanuel · COMPLETED
A high-throughput and memory-efficient inference and serving engine for LLMs
github.com/tmimmanuel/vllm · ★ 1 · Forks 0 · Size 171.7 MB
SUMMARY
Technologies 23
Scored 23
Observed 23
Practices 6
Evidence 24
Skips 0
COVERAGE
Analyzed 4272 files · 14889 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
C++ LANGUAGE Depth 70
93 files · PRODUCTION
Shell LANGUAGE Depth 70
94 files · PRODUCTION
JavaScript LANGUAGE Depth 70
6 files · PRODUCTION
JSON LANGUAGE Depth 70
562 files · PRODUCTION
TOML LANGUAGE Depth 70
2 files · PRODUCTION
Markdown LANGUAGE Depth 70
236 files · PRODUCTION
YAML LANGUAGE Depth 70
198 files · PRODUCTION
Python LANGUAGE Depth 70
2687 files · PRODUCTION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
AWS SDK CLOUD Depth 58
1 files · PRODUCTION
FastAPI FRAMEWORK Depth 81
66 files · PRODUCTION, TEST
Jinja2 LIBRARY Depth 74
4 files · PRODUCTION
NumPy LIBRARY Depth 85
225 files · PRODUCTION, TEST
Pydantic LIBRARY Depth 100
67 files · CONFIGURATION, PRODUCTION, TEST
Redis CACHE Depth 76
3 files · CONFIGURATION
Requests LIBRARY Depth 81
71 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 74
14 files · PRODUCTION
TypeScript LANGUAGE Depth 100
208 files · CONFIGURATION, PRODUCTION, TEST
Uvicorn LIBRARY Depth 81
7 files · PRODUCTION
pandas LIBRARY Depth 85
23 files · PRODUCTION, TEST
pytest TESTING Depth 78
756 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-02-09
Last commit 2026-03-16
Active months 38
Commits 14889