Biptoken JustVugg · COMPLETED
Fast BPE tokenizer with guaranteed perfect text reconstruction. 2x faster than tiktoken at encoding/decoding while preserving all whitespace and formatting.
github.com/JustVugg/Biptoken · ★ 2 · Forks 0 · Size 46 KB
SUMMARY
Technologies 3
Scored 3
Observed 3
Practices 6
Evidence 3
Skips 0
COVERAGE
Analyzed 9 files · 17 commits · 0 API calls
TECHNOLOGIES & DEPTH
Markdown LANGUAGE Depth 70
1 files · PRODUCTION
Python LANGUAGE Depth 70
6 files · PRODUCTION
NumPy LIBRARY Depth 58
2 files · PRODUCTION
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · absentcontainerization · absentlinting · absentformatting · absent
ACTIVITY & OWNERSHIP
First commit 2025-06-13
Last commit 2025-06-13
Active months 1
Commits 17