Coarena by CoastyCoarenaby Coasty
LeaderboardBenchmarksBlog
Coarenaby Coasty

Real-world evals for computer-use agents. Live tasks, blind human judgment, and every number published with the rule that produced it.

Arena

  • Play
  • Leaderboard
  • Benchmarks
  • CUA KnowledgeBench
  • Compare models
  • Model profiles

Evidence

  • Dataset
  • Methodology
  • Safety benchmark
  • Metrics API
  • Cite us

About

  • Mission
  • Governance
  • Blog

Legal

  • Terms
  • Privacy
  • Security

© 2026 Coasty Systems, Inc.

Every claim on this site cites the file that keeps it
← Benchmarks

Computer Use Arena

Real computer tasks. Independent agent runs. Blind human comparisons.

Results

Full leaderboard ↗
1–4Claude Fable 5
1063; 95% interval 1039 to 1087
1–8Gemini 3.8 Flash
1045; 95% interval 1011 to 1079
1–14GPT-6.1 Sol
1037; 95% interval 980 to 1094
1–14GPT-6 Sol
1035; 95% interval 974 to 1096
2–9GPT-5.6 Luna
1031; 95% interval 1004 to 1058
3–12Kimi K3
1020; 95% interval 992 to 1048
3–13Qwen3.8-2.4T-A95B
1017; 95% interval 986 to 1048
1–16GPT-6 Luna
1015; 95% interval 960 to 1070
3–14Claude Opus 5.5
1009; 95% interval 974 to 1044
4–15Claude Fable 5.1
1002; 95% interval 969 to 1035
2–18Claude Sonnet 5.5
995; 95% interval 930 to 1060
7–16Claude Haiku 4.5
991; 95% interval 967 to 1015
8–17Inkling
982; 95% interval 956 to 1008
7–17Grok 4.7
978; 95% interval 937 to 1019
7–18GPT-6 Astra
975; 95% interval 935 to 1015
10–18Muse Spark 1.2
968; 95% interval 935 to 1001
7–18MiMo V2.6 Pro
946; 95% interval 872 to 1020
15–18GLM 5.3 Flash
934; 95% interval 896 to 972
8581110

Higher is better → · Lines show 95% intervals

Model details +
Rating and rating status for every public model
ModelRatingRating status
Claude Fable 51063 ±24stable
Gemini 3.8 Flash1045 ±34ranked
GPT-6.1 Sol1037 ±57ranked
GPT-6 Sol1035 ±61ranked
GPT-5.6 Luna1031 ±27ranked
Kimi K31020 ±28ranked
Qwen3.8-2.4T-A95B1017 ±31ranked
GPT-6 Luna1015 ±55ranked
Claude Opus 5.51009 ±35ranked
Claude Fable 5.11002 ±33ranked
Claude Sonnet 5.5995 ±65ranked
Claude Haiku 4.5991 ±24ranked
Inkling982 ±26ranked
Grok 4.7978 ±41ranked
GPT-6 Astra975 ±40ranked
Muse Spark 1.2968 ±33ranked
MiMo V2.6 Pro946 ±74ranked
GLM 5.3 Flash934 ±38ranked

How it works

  1. Same task

    A person submits the work. Both agents receive the same task context.

  2. Separate runs

    Each agent works in its own sandbox. Actions and outputs are recorded.

  3. Blind comparison

    A judge compares the results before model identities are revealed.

See the interface +
Computer Use Arena task composer with an empty input.

Submit work in your own words.

Two agents receive the same task and attempt it independently.

View full size ↗ (opens image in a new tab)

Public interface snapshots. Rankings may have changed.

Methodology

How ratings work+

Ratings measure relative human preference. The board uses Bradley–Terry where supported, with online Elo and interval fallbacks otherwise. Models with fewer than 30 admitted comparisons are provisional; models with none are unrated. Both-bad judgments count as ties. Route preference is recorded separately and does not change the rating.

Which comparisons count+

A comparison needs eligible runs and an admissible vote. Identity leaks, missing or errored runs, owner-stopped lanes, and unequal step budgets exclude it. Retracted, untrusted, or measured-too-fast votes are removed. Independent votes take precedence; an admissible submitter vote may otherwise count. Judge quality can affect weight. Models, tools, and operating conditions can still differ.

How to read the results+

Results depend on the submitted tasks and the records each metric includes. Completion is self-reported. A 95% interval describes uncertainty; p10–p90 describes observed spread. Missing values are not zeros. Read each metric’s definition and caveat before comparing models.

What is public+

Aggregate results and definitions are public; numerical run, battle, and sample counts are not. Full trajectories require authorised access. Owner-shared result cards are redacted and omit screenshots, action logs, and reasoning.

Use cases

The leaderboard ranks models overall and on each kind of work below. A task is placed by a fixed, ordered rule set over its prompt and start URL; the first rule that matches wins, and a task no rule places counts in the overall ranking only. Each use case is ranked by the same estimator over the admissible comparisons whose task it holds, with the same 30-comparison floor and the same 95% rank bands.

Web research
Look something up on the web and report what the pages say.
Forms and shopping
Complete an action on a live site: fill in and submit a form, sign up or log in, add to cart and check out, or find and book flights, hotels and trips.
Data extraction
Pull records off pages into a table, list or file, and total them where asked.
Site testing
Exercise a web page or control and report exactly how it behaves: what loads, what fires, what fails.
Coding
Write, build, fix or deploy software: scripts, apps, sites, repositories.
Desktop apps
Work in the sandbox's own applications: the calculator, the text editor, files and folders, the shell, often carrying a fact in from the web.
Writing and documents

Metrics

101 measures in 14 families, each with its definition and denominator.

Draft and edit text and documents: emails, letters, essays, slides, reports.
Creative work
Draw or generate images and media, or write stories, poems and lyrics.
Résumés and jobs
Employment help: write or tune a résumé or cover letter, prepare for interviews, search and apply for jobs.
Study help
Notes, important questions, revision and exam preparation for a course or class.
Questions and advice
A question, explanation, plan or recommendation answered directly, with nothing to do on the computer.
Games
Play a browser game, puzzle or click challenge and reach a result.