SWELancer-Benchmark BoxiYu · PARTIAL
This repo contains the dataset and code for the paper "SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?"
github.com/BoxiYu/SWELancer-Benchmark · ★ 0 · Forks 0 · Size 37.7 MB
SUMMARY
Technologies 21
Scored 19
Observed 19
Practices 6
Evidence 23
Skips 2
COVERAGE
Analyzed 2990 files · 39 commits · 0 API calls
TECHNOLOGIES & DEPTH
Dockerfile LANGUAGE Depth 70
1 files · PRODUCTION
Shell LANGUAGE Depth 70
1 files · PRODUCTION
JSON LANGUAGE Depth 70
382 files · PRODUCTION
TOML LANGUAGE Depth 70
3 files · PRODUCTION
Markdown LANGUAGE Depth 70
3 files · PRODUCTION
YAML LANGUAGE Depth 70
8 files · PRODUCTION
Python LANGUAGE Depth 70
678 files · PRODUCTION
uv BUILD_TOOL Depth 80
1 files · CONFIGURATION
pip BUILD_TOOL Depth 80
1 files · CONFIGURATION
Poetry BUILD_TOOL Depth 80
1 files · CONFIGURATION
ESLint QUALITY Depth 81
18 files · CONFIGURATION
MongoDB DATABASE Depth 61
1 files · CONFIGURATION
NumPy LIBRARY Depth 74
13 files · PRODUCTION
Playwright LIBRARY Depth 78
656 files · PRODUCTION
Pydantic LIBRARY Depth 66
3 files · PRODUCTION
Requests LIBRARY Depth 66
3 files · PRODUCTION
TypeScript LANGUAGE Depth 78
10 files · PRODUCTION
lxml LIBRARY Depth —
0 files · config only
pandas LIBRARY Depth 54
1 files · PRODUCTION
pytest TESTING Depth 74
210 files · PRODUCTION
python-dotenv LIBRARY Depth —
0 files · config only
PRACTICES
documentation · observedautomated_tests · observedcontinuous_integration · observedcontainerization · observedlinting · observedformatting · absent
ACTIVITY & OWNERSHIP
First commit 2025-02-18
Last commit 2025-02-24
Active months 1
Commits 39