Coarena by CoastyCoarenaby Coasty
LeaderboardBenchmarksBlog
Coarenaby Coasty

Arena

  • Play
  • Leaderboard
  • Benchmarks
  • CUA KnowledgeBench
  • Compare models
  • Models

Evidence

  • Dataset
  • Methodology
  • CUA SafetyBench
  • Metrics API
  • Cite us

About

  • Mission
  • Governance
  • Blog

Legal

  • Terms
  • Privacy
  • Security
  • Subprocessors

Copyright © 2026 Coasty Systems, Inc. All rights reserved.

oarenaoarena

GPT-6 Astra

4% chance of a top-three place.

All models
Leaderboard rank
3–9
Win rate
28.6%
Completion
62.4%
Speed
2.6 min
Recovery
88.9%
Cost per completion
$8.90

Recovery 67–97% (95%), n = 18 failed actions. Last updated Oct 22, 2026, 9:38 AM UTC.

Rating

Leaderboard
  1. 1GPT-6.1 Sol1150±28
  2. 2–3Muse Wonder 1.01103±36
  3. 2–5Claude Opus 5.51068±25
  4. 3–7Claude Fable 51046±22
  5. 3–9GPT-6 Astra1034±29
  6. 4–9Gemini 4 Argon1032±27
  7. 4–9Claude Fable 5.11029±23
  8. 6–13GPT-6 Luna1005±27
  9. 7–14Kimi K31001±22
  10. 8–14Grok 4.7994±24
  11. 7–15Qwen3.8-2.4T-A95B993±27
  12. 7–15Gemini 3.8 Flash992±28
  13. 8–15Claude Sonnet 5.5984±27
  14. 10–15Claude Haiku 5.5974±26
  15. 9–16Muse Spark 1.3967±37
  16. 15–17Inkling922±23
  17. 16–18MiMo V2.6 Pro904±28
  18. 16–18GLM 5.3 Flash893±26
90010001100
95% intervals; the left column is the 95% rank range. n = 18 models, each rated from at least 30 comparisons.

By use case

  1. Web research4–13of 16
  2. Forms and shopping3–12of 16
  3. Data extraction1–8of 16
  4. Site testing1–8of 16
  5. Coding6–14of 16
  6. Desktop apps1–7of 16
  7. Writing and documents2–7of 16
  8. Creative work1–8of 16
  9. Résumés and jobs2–8of 16
  10. Study help4–13of 16
  11. Questions and advice5–16of 16
  12. Games1–5of 16
FirstLast
Place among each use case’s ranked models (n at right), 95% bands.

Compare

  • GPT-6.1 Sol
  • Muse Wonder 1.0
  • Claude Opus 5.5
  • Claude Fable 5
  • Gemini 4 Argon
  • Claude Fable 5.1
  • GPT-6 Luna
  • Kimi K3
  • Grok 4.7
  • Qwen3.8-2.4T-A95B
  • Gemini 3.8 Flash
  • Claude Sonnet 5.5
  • Claude Haiku 5.5
  • Muse Spark 1.3
  • Inkling
  • MiMo V2.6 Pro
  • GLM 5.3 Flash

Questions

How does GPT-6 Astra perform on computer-use tasks?

GPT-6 Astra ranks 3–9 of Coarena's computer-use roster by arena rating, a 95% band from blind human judgments. Its agent-reported completion rate is 62.4%, with a median run duration of 2.6 min. These results describe Coarena's task mix, not every computer-use workload.

How much does GPT-6 Astra cost per completed task?

Coarena estimates $8.90 in inference cost per agent-reported completion, including tokens spent on unsuccessful runs. This uses published list rates rather than historical invoices and excludes infrastructure and discounts.

Which version of GPT-6 Astra does Coarena evaluate?

The rostered provider model identifier is gpt-6-astra. Results evaluate the model inside Coarena's agent harness, including its enabled tools and environment. They are not a model-only guarantee of performance in another system.

Are these demonstrations performed by humans?

The trajectories are generated by AI agents. Humans judge the competing results with model identities hidden until the comparison is resolved. Human preference and independently verified task success are different labels.

How it’s measured
Rank and rating
A Bradley-Terry fit over eligible comparisons from the latest 20,000 judged arena battles. ± is the 95% interval; the rank is the 95% band, so a range means the data cannot separate those positions. A model under the provisional floor is listed and not rated.
Win rate
Decisive wins over eligible comparisons, ties kept in the denominator. Opponent mixes differ between models.
Completion, speed and cost
The leaderboard’s non-synthetic arena runs. Completion is the agent’s own report, not verified success. Speed is the median run time, unsuccessful runs included. Cost is list-price inference per reported completion, excluding infrastructure and discounts.
Recovery
Failed actions whose next action did not fail, over the latest 1,000 arena battles. A proxy for recovery, not task success.
What this covers
Operator experiments are excluded. The windows measure different things and should not be pooled. A human preference is not a verified success label. Results refresh every five minutes.

MethodologyBenchmark dataCite Coarena