smg eric8810 · PARTIAL
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
github.com/eric8810/smg · ★ 0 · Forks 0 · Size 15.6 MB
SUMMARY
Technologies 37
Scored 34
Observed 34
Practices 6
Evidence 63
Skips 3
COVERAGE
Analyzed 1080 files · 1471 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
2 files · PRODUCTION
Shell LANGUAGE Depth 70
38 files · PRODUCTION
Rust LANGUAGE Depth 70
621 files · PRODUCTION
XML LANGUAGE Depth 70
1 files · PRODUCTION
Go LANGUAGE Depth 70
24 files · PRODUCTION
JSON LANGUAGE Depth 70
1 files · PRODUCTION
Markdown LANGUAGE Depth 70
77 files · PRODUCTION
TOML LANGUAGE Depth 70
34 files · PRODUCTION
YAML LANGUAGE Depth 70
79 files · PRODUCTION
Python LANGUAGE Depth 70
118 files · PRODUCTION
SQL LANGUAGE Depth 70
3 files · PRODUCTION
Cargo BUILD_TOOL Depth 80
1 files · CONFIGURATION
Maven BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
Go Modules BUILD_TOOL Depth 80
1 files · CONFIGURATION
Axum FRAMEWORK Depth 78
131 files · PRODUCTION, TEST
Bytes LIBRARY Depth 81
14 files · PRODUCTION, TEST
Clap LIBRARY Depth —
0 files · config only
Jackson LIBRARY Depth —
0 files · config only
Jinja2 LIBRARY Depth 58
1 files · PRODUCTION
NumPy LIBRARY Depth 85
5 files · PRODUCTION, TEST
PostgreSQL DATABASE Depth 69
2 files · CONFIGURATION
Pydantic LIBRARY Depth 62
2 files · PRODUCTION
Redis CACHE Depth 100
6 files · CONFIGURATION, PRODUCTION
Requests LIBRARY Depth 74
4 files · PRODUCTION, TEST
Reqwest LIBRARY Depth 81
14 files · PRODUCTION, TEST
Serde LIBRARY Depth 100
74 files · CONFIGURATION, PRODUCTION, TEST
Tokio LIBRARY Depth 85
141 files · PRODUCTION, TEST
Tokio Stream LIBRARY Depth 81
11 files · PRODUCTION, TEST
Tokio Util LIBRARY Depth 74
4 files · PRODUCTION
Tracing OBSERVABILITY Depth —
0 files · config only
TypeScript LANGUAGE Depth 66
2 files · PRODUCTION
Zap OBSERVABILITY Depth 74
5 files · PRODUCTION
debug LIBRARY Depth 96
6 files · CONFIGURATION, PRODUCTION
gRPC LIBRARY Depth 58
1 files · PRODUCTION
pandas LIBRARY Depth 58
1 files · PRODUCTION
pytest TESTING Depth 81
42 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2024-12-12
Last commit 2026-04-12
Active months 16
Commits 1471