TensorRT-LLM EbiAraz · COMPLETED
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
github.com/EbiAraz/TensorRT-LLM · ★ 0 · Forks 0 · Size 1.8 GB
SUMMARY
Technologies 27
Scored 27
Observed 27
Practices 6
Evidence 29
Skips 0
COVERAGE
Analyzed 10490 files · 7320 commits · 0 API calls
TECHNOLOGIES & DEPTH
C++ LANGUAGE Depth 70
1319 files · PRODUCTION
Shell LANGUAGE Depth 70
76 files · PRODUCTION
C LANGUAGE Depth 70
1 files · PRODUCTION
JavaScript LANGUAGE Depth 70
2 files · PRODUCTION
JSON LANGUAGE Depth 70
37 files · PRODUCTION
TOML LANGUAGE Depth 70
69 files · PRODUCTION
Markdown LANGUAGE Depth 70
457 files · PRODUCTION
YAML LANGUAGE Depth 70
770 files · PRODUCTION
Python LANGUAGE Depth 70
2816 files · PRODUCTION
uv BUILD_TOOL Depth 80
1 files · CONFIGURATION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
Click LIBRARY Depth 85
40 files · PRODUCTION, TEST
Elasticsearch DATABASE Depth 81
41 files · CONFIGURATION
FastAPI FRAMEWORK Depth 81
12 files · PRODUCTION, TEST
Jinja2 LIBRARY Depth 85
7 files · PRODUCTION, TEST
MongoDB DATABASE Depth 72
2 files · CONFIGURATION
NumPy LIBRARY Depth 100
276 files · CONFIGURATION, PRODUCTION, TEST
Pydantic LIBRARY Depth 85
88 files · PRODUCTION, TEST
Redis CACHE Depth 88
51 files · CONFIGURATION
Requests LIBRARY Depth 85
43 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 81
11 files · PRODUCTION, TEST
TypeScript LANGUAGE Depth 85
698 files · PRODUCTION, TEST
Uvicorn LIBRARY Depth 81
10 files · PRODUCTION, TEST
debug LIBRARY Depth 70
3 files · PRODUCTION, TEST
pandas LIBRARY Depth 85
24 files · PRODUCTION, TEST
pytest TESTING Depth 85
706 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · observed
ACTIVITY & OWNERSHIP
First commit 2023-09-20
Last commit 2026-06-17
Active months 34
Commits 7320