10 tasks evaluated across all models.
| Task | Complexity | Pass rate | Avg duration | Models |
|---|---|---|---|---|
| Migrate from fs.readFile(callback) to fs.promises.readFile() | medium | 83% | 3m 58s | 6 |
| A test passes for the wrong reason — find the real fix | complex | 83% | 3m 55s | 6 |
| Find and fix an event listener leak | complex | 83% | 1m 45s | 6 |
| Rename a public function across the codebase | medium | 80% | 1m 10s | 5 |
| Fix concurrent counter race condition | complex | 80% | 2m 11s | 5 |
| Restore linear performance in a hot loop | medium | 80% | 4m 2s | 5 |
| Add an options parameter to format() without breaking callers | medium | 80% | 2m 26s | 5 |
| Read SPEC.md and implement the right behavior | medium | 80% | 1m 17s | 5 |
| Two parsers disagree on the same config file | complex | 80% | 2m 24s | 5 |
| Fix implicit string→number coercion in comparison | medium | 80% | 2m 21s | 5 |