TensorRT-LLM kevalmorabia97 · COMPLETED
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
github.com/kevalmorabia97/TensorRT-LLM · ★ 0 · Forks 0 · Size 1.5 GB
SUMMARY
Technologies 27
Scored 27
Observed 27
Practices 6
Evidence 29
Skips 0
COVERAGE
Analyzed 10213 files · 5752 commits · 0 API calls
TECHNOLOGIES & DEPTH
C++ LANGUAGE Depth 70
5681 files · PRODUCTION
Shell LANGUAGE Depth 70
73 files · PRODUCTION
C LANGUAGE Depth 70
1 files · PRODUCTION
JavaScript LANGUAGE Depth 70
2 files · PRODUCTION
JSON LANGUAGE Depth 70
28 files · PRODUCTION
TOML LANGUAGE Depth 70
69 files · PRODUCTION
Markdown LANGUAGE Depth 70
315 files · PRODUCTION
YAML LANGUAGE Depth 70
730 files · PRODUCTION
Python LANGUAGE Depth 70
2283 files · PRODUCTION
uv BUILD_TOOL Depth 80
1 files · CONFIGURATION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
Click LIBRARY Depth 85
36 files · PRODUCTION, TEST
Elasticsearch DATABASE Depth 81
40 files · CONFIGURATION
FastAPI FRAMEWORK Depth 81
9 files · PRODUCTION, TEST
Jinja2 LIBRARY Depth 77
4 files · PRODUCTION
MongoDB DATABASE Depth 72
2 files · CONFIGURATION
NumPy LIBRARY Depth 100
235 files · CONFIGURATION, PRODUCTION, TEST
Pydantic LIBRARY Depth 85
60 files · PRODUCTION, TEST
Redis CACHE Depth 88
51 files · CONFIGURATION
Requests LIBRARY Depth 85
35 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 78
5 files · PRODUCTION
TypeScript LANGUAGE Depth 85
616 files · PRODUCTION, TEST
Uvicorn LIBRARY Depth 81
8 files · PRODUCTION, TEST
debug LIBRARY Depth 70
3 files · PRODUCTION, TEST
pandas LIBRARY Depth 85
26 files · PRODUCTION, TEST
pytest TESTING Depth 85
479 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · observed
ACTIVITY & OWNERSHIP
First commit 2023-09-20
Last commit 2026-03-25
Active months 31
Commits 5752