SWELancer-Benchmark jozef-javorsky-dodo · PARTIAL
This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?"
github.com/jozef-javorsky-dodo/SWELancer-Benchmark · ★ 1 · Forks 0 · Size 36.9 MB
SUMMARY
Technologies 21
Scored 19
Observed 19
Practices 6
Evidence 23
Skips 2
COVERAGE
Analyzed 3031 files · 49 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Shell LANGUAGE Depth 70
1 files · PRODUCTION
JSON LANGUAGE Depth 70
382 files · PRODUCTION
Markdown LANGUAGE Depth 70
3 files · PRODUCTION
TOML LANGUAGE Depth 70
3 files · PRODUCTION
YAML LANGUAGE Depth 70
8 files · PRODUCTION
Python LANGUAGE Depth 70
718 files · PRODUCTION
uv BUILD_TOOL Depth 80
1 files · CONFIGURATION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
ESLint QUALITY Depth 81
18 files · CONFIGURATION
MongoDB DATABASE Depth 61
1 files · CONFIGURATION
NumPy LIBRARY Depth 74
15 files · PRODUCTION
Playwright LIBRARY Depth 78
695 files · PRODUCTION
Pydantic LIBRARY Depth 66
3 files · PRODUCTION
Requests LIBRARY Depth 74
4 files · PRODUCTION
TypeScript LANGUAGE Depth 78
10 files · PRODUCTION
lxml LIBRARY Depth —
0 files · config only
pandas LIBRARY Depth 54
1 files · PRODUCTION
pytest TESTING Depth 74
220 files · PRODUCTION
python-dotenv LIBRARY Depth —
0 files · config only
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2025-02-18
Last commit 2025-04-03
Active months 3
Commits 49