Posts tagged with: Benchmarks

A New Benchmark Tested AI Coding Agents on Real Company Codebases. The Winning Score Was 38.8%.

Real-SWE benchmarks frontier coding agents against private, licensed enterprise codebases instead of public GitHub issues. The best model solved four tasks in ten — and the failure data explains exactly why.