RS9 Everyday Agent Bench, 2 October 2026
One dated run. These are the results as they stood that day.
RS9 Everyday Agent Bench
Best results
Score out of 100, highest first
Best value
Cost per task passed, cheapest first
Subscription agents: what the same work would cost at public API prices. OpenRouter: the real charge.
20 tasks · one attempt each
rs9.com.au/benchmarks
Score is the percentage of tasks passed, one attempt each. Partial credit (in the table below) gives each task the share of its checks that passed, so it can split agents on the same score.
Value is total cost divided by tasks passed, so an agent that's cheap but fails a lot doesn't look good. It sits beside the score and never changes it.
A few of the 20 tasks are “frontier” tasks, added to stretch the top models.
View the results as a table
| Model | Agent tool | Score | Tasks passed | Partial credit | Total time |
|---|---|---|---|---|---|
| Opus 5.5 | Claude Code | 95 | 19 of 20 | 99 | 1 h 48 min |
| Sonnet 5.5 | Claude Code | 75 | 15 of 20 | 99 | 1 h 36 min |
| Fable 5.1 | Claude Code | 70 | 14 of 20 | 99 | 2 h 42 min |
View the value board as a table
| Model | Agent tool | Cost per task passed | Tasks passed |
|---|---|---|---|
| Sonnet 5.5 | Claude Code | $1.11 per task passed | 15 of 20 |
| Opus 5.5 | Claude Code | $1.28 per task passed | 19 of 20 |
| Fable 5.1 | Claude Code | $5.12 per task passed | 14 of 20 |
We gave 3 coding agents the same 20 tasks from the kind of work RS9 does, then checked whether each one got the job done. One attempt each, same brief and files, 60 minutes a task.
It's not a research study. Each agent gets one go at each task, so a gap of a task or two means very little. And these are our tasks, so how an agent does here says little about how it'll do on yours. How it's scored, and where it falls short, is on the methodology page.
Latest run: . These are the versions we tested that day. Update an agent and its numbers can change.
Over time
§1Is each agent holding steady?
Select an agent in the key to pick out its line.
A diamond means the agent's model or client version changed since its last run. Select an agent to step through its points with the keyboard.
Score, run by run
We rerun the benchmark regularly. Each line follows one agent across the dated runs. With one attempt per task, a few points either way is normal wobble. A steady drift is what to look for.
View this chart as a table
| Model and agent tool | 30 Sept | 2 Oct |
|---|---|---|
| Fable 5.1 with Claude Code | score 70, $5.91 per pass | score 70, $5.12 per pass |
| Opus 5.5 with Claude Code | score 95, $1.62 per pass | score 95, $1.28 per pass |
| Sonnet 5.5 with Claude Code | score 85, $1.00 per pass | score 75, $1.11 per pass |
| GPT-6 Astra with Codex | score 85, $1.75 per pass | not run |
| Sol 6.1 with Codex | score 80, $0.45 per pass | not run |
| Grok 4.7 with Grok Build | score 65, $4.56 per pass | not run |
| Muse Spark 1.3 with Muse Code | score 55, cost n/a | not run |
| DeepSeek V4.1 Flash with OpenCode (OpenRouter) | score 70, $0.085 per pass | not run |
Speed
§2Passing versus time taken
Times include the provider's server speed and queueing, so a slow time can mean a busy server.
Score against time taken
Each dot is one model with its agent tool. Higher is a better score. Further left means less total time across its 20 attempts. Top left is the best spot. Hover or tab to a dot to see which is which.
View this chart as a table
| Model | Agent tool | Score | Tasks passed | Total time |
|---|---|---|---|---|
| Opus 5.5 | Claude Code | 95 | 19 of 20 | 1 h 48 min |
| Sonnet 5.5 | Claude Code | 75 | 15 of 20 | 1 h 36 min |
| Fable 5.1 | Claude Code | 70 | 14 of 20 | 2 h 42 min |
Cost
§3What each passed task cost
Subscription agents don't bill per task. So we count the tokens each attempt used and price them at the provider's public API rates. It's not what anyone paid, but it puts every agent on one scale.
The OpenRouter model shows the real charge, which can sit well below list price if the host discounts it. If there's no public price for a model, it says “price unknown”. Never $0.
Cost per task passed
Total cost divided by tasks passed, for each agent. A shorter bar is cheaper. All amounts are US dollars.
View this chart as a table
| Model | Agent tool | Cost per pass | Total cost | Tasks passed | Basis |
|---|---|---|---|---|---|
| Sonnet 5.5 | Claude Code | $1.11 | $16.63 | 15 of 20 | Subscription: what the same tokens would cost at the provider's public API price |
| Opus 5.5 | Claude Code | $1.28 | $24.25 | 19 of 20 | Subscription: what the same tokens would cost at the provider's public API price |
| Fable 5.1 | Claude Code | $5.12 | $71.66 | 14 of 20 | Subscription: what the same tokens would cost at the provider's public API price |
Score against cost per task passed
Each dot is one model with its agent tool. Higher is a better score. Further left means each passed task cost less. Top left is the best spot. Hover or tab to a dot to see which is which.
View this chart as a table
| Model | Agent tool | Score | Tasks passed | Cost per pass |
|---|---|---|---|---|
| Opus 5.5 | Claude Code | 95 | 19 of 20 | $1.28 |
| Sonnet 5.5 | Claude Code | 75 | 15 of 20 | $1.11 |
| Fable 5.1 | Claude Code | 70 | 14 of 20 | $5.12 |
The agents
§4What we tested
Times include the provider's server speed and queueing, so a slow time can mean a busy server.
Fable 5.1
with Claude Code
- Model
- Claude Fable 5.1
- Reasoning
- High
- Client version
- 2.1.285 (Claude Code)
- Score
- 70, partial credit 99
- Passed
- 14 of 20
- Total time
- 2 h 42 min
- Total cost
- US$71.66
- Cost per pass
- US$5.12
Subscription, at API list price.
Claude Code in headless mode, high reasoning effort, on a Claude subscription.
Opus 5.5
with Claude Code
- Model
- Claude Opus 5.5
- Reasoning
- High
- Client version
- 2.1.285 (Claude Code)
- Score
- 95, partial credit 99
- Passed
- 19 of 20
- Total time
- 1 h 48 min
- Total cost
- US$24.25
- Cost per pass
- US$1.28
Subscription, at API list price.
Claude Code in headless mode, high reasoning effort, on a Claude subscription.
Sonnet 5.5
with Claude Code
- Model
- Claude Sonnet 5.5
- Reasoning
- High
- Client version
- 2.1.285 (Claude Code)
- Score
- 75, partial credit 99
- Passed
- 15 of 20
- Total time
- 1 h 36 min
- Total cost
- US$16.63
- Cost per pass
- US$1.11
Subscription, at API list price.
Claude Code in headless mode, high reasoning effort, on a Claude subscription.
History
§5Runs
- 2 October 2026 this page
- 30 September 2026