TensorRT-LLM ardiannurcahya · COMPLETED
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
github.com/ardiannurcahya/TensorRT-LLM · ★ 0 · Forks 0 · Size 1.7 GB
SUMMARY
Technologies 26
Scored 26
Observed 26
Practices 6
Evidence 28
Skips 0
COVERAGE
Analyzed 8915 files · 4863 commits · 0 API calls
TECHNOLOGIES & DEPTH
C++ LANGUAGE Depth 70
5262 files · PRODUCTION
Shell LANGUAGE Depth 70
66 files · PRODUCTION
C LANGUAGE Depth 70
1 files · PRODUCTION
JavaScript LANGUAGE Depth 70
1 files · PRODUCTION
JSON LANGUAGE Depth 70
25 files · PRODUCTION
Markdown LANGUAGE Depth 70
291 files · PRODUCTION
TOML LANGUAGE Depth 70
62 files · PRODUCTION
YAML LANGUAGE Depth 70
455 files · PRODUCTION
Python LANGUAGE Depth 70
1827 files · PRODUCTION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
Click LIBRARY Depth 85
32 files · PRODUCTION, TEST
Elasticsearch DATABASE Depth 81
40 files · CONFIGURATION
FastAPI FRAMEWORK Depth 81
7 files · PRODUCTION, TEST
Jinja2 LIBRARY Depth 73
3 files · PRODUCTION
MongoDB DATABASE Depth 65
1 files · CONFIGURATION
NumPy LIBRARY Depth 100
208 files · CONFIGURATION, PRODUCTION, TEST
Pydantic LIBRARY Depth 85
45 files · PRODUCTION, TEST
Redis CACHE Depth 88
19 files · CONFIGURATION
Requests LIBRARY Depth 85
27 files · PRODUCTION, TEST
Starlette FRAMEWORK Depth 78
5 files · PRODUCTION
TypeScript LANGUAGE Depth 85
535 files · PRODUCTION, TEST
Uvicorn LIBRARY Depth 81
8 files · PRODUCTION, TEST
debug LIBRARY Depth 70
3 files · PRODUCTION, TEST
pandas LIBRARY Depth 85
25 files · PRODUCTION, TEST
pytest TESTING Depth 85
379 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · observed
ACTIVITY & OWNERSHIP
First commit 2023-09-20
Last commit 2026-01-28
Active months 29
Commits 4863