vllm shimmyshimmer · COMPLETED
A high-throughput and memory-efficient inference and serving engine for LLMs
github.com/shimmyshimmer/vllm · ★ 0 · Forks 0 · Size 44.0 MB
SUMMARY
Technologies 23
Scored 23
Observed 23
Practices 6
Evidence 24
Skips 0
COVERAGE
Analyzed 2230 files · 5737 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Shell LANGUAGE Depth 70
40 files · PRODUCTION
C++ LANGUAGE Depth 70
60 files · PRODUCTION
JavaScript LANGUAGE Depth 70
2 files · PRODUCTION
JSON LANGUAGE Depth 70
352 files · PRODUCTION
TOML LANGUAGE Depth 70
1 files · PRODUCTION
Markdown LANGUAGE Depth 70
145 files · PRODUCTION
YAML LANGUAGE Depth 70
64 files · PRODUCTION
Python LANGUAGE Depth 70
1330 files · PRODUCTION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
AWS SDK CLOUD Depth 58
1 files · PRODUCTION
FastAPI FRAMEWORK Depth 81
15 files · PRODUCTION
Jinja2 LIBRARY Depth 78
6 files · PRODUCTION
NumPy LIBRARY Depth 85
74 files · PRODUCTION, TEST
Pydantic LIBRARY Depth 81
16 files · PRODUCTION, TEST
Redis CACHE Depth 69
2 files · CONFIGURATION
Requests LIBRARY Depth 81
27 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 66
3 files · PRODUCTION
TypeScript LANGUAGE Depth 85
73 files · PRODUCTION, TEST
Uvicorn LIBRARY Depth 73
3 files · PRODUCTION
pandas LIBRARY Depth 85
10 files · PRODUCTION
pytest TESTING Depth 78
363 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-02-09
Last commit 2025-04-09
Active months 27
Commits 5737