pass@1 is the mean reward over 400 rollouts (100 tasks × 4). pass@4 is the share of tasks solved at least once. Each rollout has a 1-hour agent time limit; timeouts count as failures. $ / rollout is the harness-recorded cost for Claude Opus 5.5, GPT-6 Astra and Qwen 3.8 Max, and otherwise trajectory tokens × OpenRouter list price as of 2026-11-03, with the cached-input discount. Click a column to sort.