DeepSWE v1.1
DeepSWE (Datacurve) is a contamination-resistant coding-agent benchmark of 113 original, long-horizon software-engineering tasks across TypeScript, Go, Python, JavaScript and Rust, each graded in an isolated environment by hand-written, program-based verifiers. Because every task is authored from scratch rather than scraped from public repositories, it resists the training-data leakage that inflates older SWE benchmarks. It shares its name with — but is unrelated to — DeepSWE-Preview, the open-source RL-trained coding model from Agentica and Together AI.
Official source: DeepSWE benchmark (Datacurve)