LLMLingua Kelpejol · COMPLETED
[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
github.com/Kelpejol/LLMLingua · ★ 1 · Forks 0 · Size 4.0 MB
SUMMARY
Technologies 8
Scored 8
Observed 8
Practices 6
Evidence 9
Skips 0
COVERAGE
Analyzed 73 files · 85 commits · 0 API calls
TECHNOLOGIES & DEPTH
JSON LANGUAGE Depth 70
1 files · PRODUCTION
Shell LANGUAGE Depth 70
6 files · PRODUCTION
Markdown LANGUAGE Depth 70
10 files · PRODUCTION
TOML LANGUAGE Depth 70
1 files · PRODUCTION
YAML LANGUAGE Depth 70
7 files · PRODUCTION
Python LANGUAGE Depth 70
28 files · PRODUCTION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
NumPy LIBRARY Depth 78
5 files · PRODUCTION
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · absentlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2023-07-07
Last commit 2025-10-28
Active months 17
Commits 85