The visible tests pass with a narrow implementation, but the SPEC.md file describes the full intended behavior. Read SPEC.md to understand what the function should really do. The hidden spec tests the full behavior.
| # | Model | Status | Duration | Tokens | Patch | Failure |
|---|---|---|---|---|---|---|
| 1 | MiniMax-M3minimax | pass | 32.0s | 60.9k | yes | - |
| 2 | qwen3.8-max-previewqwen | pass | 1m 21s | 79.4k | yes | - |
| 3 | deepseek-v4-pro+qwen3.8-max-previewconsensus | pass | 1m 22s | 166.2k | - | - |
| 4 | defaultinternal | pass | 1m 50s | 61.0k | yes | - |
| 5 | deepseek-v4-prodeepseek | done | 1m 21s | 86.9k | yes | - |