paddler luojiyin1987 · PARTIAL
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
github.com/luojiyin1987/paddler · ★ 0 · Forks 0 · Size 8.9 MB
SUMMARY
Technologies 29
Scored 25
Observed 25
Practices 6
Evidence 39
Skips 4
COVERAGE
Analyzed 971 files · 1047 commits · 0 API calls
TECHNOLOGIES & DEPTH
TypeScript LANGUAGE Depth 70
132 files · PRODUCTION
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Rust LANGUAGE Depth 70
616 files · PRODUCTION
JavaScript LANGUAGE Depth 70
16 files · PRODUCTION
JSON LANGUAGE Depth 70
9 files · PRODUCTION
TOML LANGUAGE Depth 70
12 files · PRODUCTION
Markdown LANGUAGE Depth 70
15 files · PRODUCTION
YAML LANGUAGE Depth 70
5 files · PRODUCTION
Python LANGUAGE Depth 70
73 files · PRODUCTION
Cargo BUILD_TOOL Depth 80
1 files · CONFIGURATION
npm BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
Actix Web FRAMEWORK Depth 74
33 files · PRODUCTION
Bytes LIBRARY Depth 62
2 files · PRODUCTION
Clap LIBRARY Depth —
0 files · config only
ESLint QUALITY Depth 65
2 files · CONFIGURATION
Lodash LIBRARY Depth —
0 files · config only
Prettier QUALITY Depth 65
2 files · CONFIGURATION
Pydantic LIBRARY Depth 74
23 files · PRODUCTION
React FRAMEWORK Depth 74
64 files · PRODUCTION
Reqwest LIBRARY Depth 81
130 files · PRODUCTION
Serde LIBRARY Depth 81
77 files · PRODUCTION
Tokio LIBRARY Depth 85
243 files · PRODUCTION
Tokio Stream LIBRARY Depth 78
5 files · PRODUCTION
Tokio Test TESTING Depth —
0 files · config only
Tokio Util LIBRARY Depth 85
47 files · PRODUCTION
Zod LIBRARY Depth 78
37 files · PRODUCTION, TEST
esbuild BUILD_TOOL Depth —
0 files · config only
pytest TESTING Depth 74
16 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · observed
ACTIVITY & OWNERSHIP
First commit 2024-04-27
Last commit 2026-05-13
Active months 25
Commits 1047