candle-vllm realsigridjin · PARTIAL
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
github.com/realsigridjin/candle-vllm · ★ 1 · Forks 0 · Size 33.5 MB
SUMMARY
Technologies 13
Scored 11
Observed 11
Practices 6
Evidence 15
Skips 2
COVERAGE
Analyzed 68 files · 346 commits · 0 API calls
TECHNOLOGIES & DEPTH
C++ LANGUAGE Depth 70
2 files · PRODUCTION
Rust LANGUAGE Depth 70
42 files · PRODUCTION
JSON LANGUAGE Depth 70
2 files · PRODUCTION
Markdown LANGUAGE Depth 70
1 files · PRODUCTION
TOML LANGUAGE Depth 70
4 files · PRODUCTION
YAML LANGUAGE Depth 70
1 files · PRODUCTION
Python LANGUAGE Depth 70
4 files · PRODUCTION
Cargo BUILD_TOOL Depth 80
1 files · CONFIGURATION
Axum FRAMEWORK Depth 78
6 files · PRODUCTION, TEST
Clap LIBRARY Depth —
0 files · config only
Serde LIBRARY Depth 78
6 files · PRODUCTION, TEST
Tokio LIBRARY Depth 78
6 files · PRODUCTION, TEST
Tracing OBSERVABILITY Depth —
0 files · config only
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · absentlinting · absentformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-10-29
Last commit 2024-08-02
Active months 9
Commits 346