vllm eric8810 · COMPLETED
A high-throughput and memory-efficient inference and serving engine for LLMs
github.com/eric8810/vllm · ★ 0 · Forks 0 · Size 152.3 MB
SUMMARY
Technologies 23
Scored 23
Observed 23
Practices 6
Evidence 24
Skips 0
COVERAGE
Analyzed 3983 files · 13786 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
C++ LANGUAGE Depth 70
90 files · PRODUCTION
Shell LANGUAGE Depth 70
87 files · PRODUCTION
JavaScript LANGUAGE Depth 70
7 files · PRODUCTION
JSON LANGUAGE Depth 70
546 files · PRODUCTION
Markdown LANGUAGE Depth 70
219 files · PRODUCTION
TOML LANGUAGE Depth 70
2 files · PRODUCTION
YAML LANGUAGE Depth 70
186 files · PRODUCTION
Python LANGUAGE Depth 70
2481 files · PRODUCTION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
AWS SDK CLOUD Depth 58
1 files · PRODUCTION
FastAPI FRAMEWORK Depth 81
62 files · PRODUCTION, TEST
Jinja2 LIBRARY Depth 78
10 files · PRODUCTION
NumPy LIBRARY Depth 85
206 files · PRODUCTION, TEST
Pydantic LIBRARY Depth 100
62 files · CONFIGURATION, PRODUCTION, TEST
Redis CACHE Depth 76
3 files · CONFIGURATION
Requests LIBRARY Depth 81
61 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 74
12 files · PRODUCTION
TypeScript LANGUAGE Depth 100
180 files · CONFIGURATION, PRODUCTION, TEST
Uvicorn LIBRARY Depth 81
7 files · PRODUCTION
pandas LIBRARY Depth 85
23 files · PRODUCTION, TEST
pytest TESTING Depth 78
701 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-02-09
Last commit 2026-02-10
Active months 37
Commits 13786