NeMo-Curator realsigridjin · COMPLETED
Scalable data pre processing and curation toolkit for LLMs
github.com/realsigridjin/NeMo-Curator · ★ 0 · Forks 0 · Size 3.3 MB
SUMMARY
Technologies 15
Scored 15
Observed 15
Practices 6
Evidence 16
Skips 0
COVERAGE
Analyzed 391 files · 226 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Shell LANGUAGE Depth 70
10 files · PRODUCTION
Markdown LANGUAGE Depth 70
30 files · PRODUCTION
TOML LANGUAGE Depth 70
1 files · PRODUCTION
YAML LANGUAGE Depth 70
26 files · PRODUCTION
Python LANGUAGE Depth 70
234 files · PRODUCTION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
MongoDB DATABASE Depth 65
1 files · CONFIGURATION
NumPy LIBRARY Depth 85
22 files · PRODUCTION, TEST
Requests LIBRARY Depth 78
10 files · PRODUCTION
TypeScript LANGUAGE Depth 66
3 files · PRODUCTION
lxml LIBRARY Depth 58
1 files · PRODUCTION
pandas LIBRARY Depth 85
34 files · PRODUCTION, TEST
pytest TESTING Depth 74
13 files · PRODUCTION, TEST
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2024-03-15
Last commit 2024-12-16
Active months 10
Commits 226