10 tasks evaluated across all models.
| Task | Complexity | Pass rate | Avg duration | Models |
|---|---|---|---|---|
| Add capitalize util | simple | 50% | 26.2s | 4 |
| Add parseCsvLine util | simple | 0% | 4.7s | 2 |
| Add memoize util | simple | 0% | 3.9s | 2 |
| Add isValidEmail util | simple | 0% | 3.9s | 2 |
| Add sortBy util | simple | 0% | 3.9s | 2 |
| Convert config.json to env format | simple | 0% | 3.9s | 2 |
| Add safeJsonParse util | simple | 0% | 4.2s | 2 |
| Add readJsonFile util | simple | 0% | 3.8s | 2 |
| Add retry util | simple | 0% | 4.4s | 2 |
| Remove var keyword flagged by linter | simple | 0% | 4.3s | 2 |