ray_vllm_inference svngoku · COMPLETED
A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
github.com/svngoku/ray_vllm_inference · ★ 0 · Forks 0 · Size 83 KB
SUMMARY
Technologies 11
Scored 11
Observed 11
Practices 6
Evidence 11
Skips 0
COVERAGE
Analyzed 28 files · 52 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Markdown LANGUAGE Depth 70
4 files · PRODUCTION
YAML LANGUAGE Depth 70
8 files · PRODUCTION
Python LANGUAGE Depth 70
13 files · PRODUCTION
FastAPI FRAMEWORK Depth 58
1 files · PRODUCTION
NumPy LIBRARY Depth 70
3 files · PRODUCTION
Pydantic LIBRARY Depth 70
3 files · PRODUCTION, TEST
Requests LIBRARY Depth 58
1 files · PRODUCTION
Starlette FRAMEWORK Depth 58
1 files · PRODUCTION
TypeScript LANGUAGE Depth 58
1 files · PRODUCTION
pytest TESTING Depth 37
1 files · TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · absentcontainerization · observedlinting · absentformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-10-28
Last commit 2023-12-13
Active months 3
Commits 52