tokenizers zmzlois · PARTIAL
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
github.com/zmzlois/tokenizers · ★ 0 · Forks 0 · Size 7.9 MB
SUMMARY
Technologies 22
Scored 21
Observed 21
Practices 6
Evidence 26
Skips 1
COVERAGE
Analyzed 335 files · 1610 commits · 0 API calls
TECHNOLOGIES & DEPTH
TypeScript LANGUAGE Depth 70
31 files · PRODUCTION
Shell LANGUAGE Depth 70
4 files · PRODUCTION
Rust LANGUAGE Depth 70
114 files · PRODUCTION
JavaScript LANGUAGE Depth 70
17 files · PRODUCTION
JSON LANGUAGE Depth 70
10 files · PRODUCTION
TOML LANGUAGE Depth 70
6 files · PRODUCTION
Markdown LANGUAGE Depth 70
29 files · PRODUCTION
YAML LANGUAGE Depth 70
15 files · PRODUCTION
Python LANGUAGE Depth 70
60 files · PRODUCTION
Cargo BUILD_TOOL Depth 80
1 files · CONFIGURATION
npm BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
Apache Kafka MESSAGE_BROKER Depth 65
1 files · CONFIGURATION
Clap LIBRARY Depth —
0 files · config only
ESLint QUALITY Depth 80
4 files · CONFIGURATION
Elasticsearch DATABASE Depth 65
1 files · CONFIGURATION
NumPy LIBRARY Depth 37
1 files · TEST
Prettier QUALITY Depth 77
4 files · CONFIGURATION
Requests LIBRARY Depth 62
2 files · PRODUCTION
Reqwest LIBRARY Depth 58
1 files · PRODUCTION
Serde LIBRARY Depth 78
50 files · PRODUCTION
pytest TESTING Depth 74
16 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · absentlinting · observedformatting · observed
ACTIVITY & OWNERSHIP
First commit 2019-11-01
Last commit 2022-12-05
Active months 36
Commits 1610