Computer-use model comparison
In eligible head-to-head comparisons, Inkling has a 27.6% decisive win rate and Qwen3.8-2.4T-A95B has 41.4%. 31.0% end without a decisive preference. This matchup is provisional; the evidence is limited.
These are arena-wide results. Each model encounters a different mix of tasks and opponents. The direct matchup, when available, is reported separately.
| Measure | Inklingranked | Qwen3.8-2.4T-A95Branked |
|---|---|---|
| Leaderboard rankThe 95% rank band from the arena's Bradley–Terry fit. A range means the data cannot separate those positions; a model under the provisional floor takes no rank. | 7–16 | 2–12 |
| Win rate · all opponentsDecisive wins / eligible comparisons. Ties stay in the denominator. Opponent mixes differ. | 31.9% | 37.3% |
| CompletionAgent-reported completed runs / non-synthetic arena runs. Completion is not independently verified success. | 75.1% | 66.3% |
| Speed |
In eligible head-to-head comparisons, Inkling has a 27.6% decisive win rate and Qwen3.8-2.4T-A95B has 41.4%. 31.0% end without a decisive preference. This matchup is provisional; the evidence is limited.
No. Completion for Inkling and Qwen3.8-2.4T-A95B records whether the agent reported finishing. Human preferences, task success and next-action recovery are different measurements.
Read speed and estimated cost alongside completion and human preference. An early failure can be fast. Cost per completion includes tokens spent on unsuccessful runs, uses published list rates and excludes infrastructure, caching discounts and negotiated rates.
Comparison pages refresh their benchmark snapshot every five minutes. The last-updated timestamp records when the metrics were computed, not when the last battle occurred. Model rank may move between snapshots.
| 1.3 min |
| 4.2 min |
| RecoveryFailed actions whose next action did not fail. Recent benchmark window; a proxy for recovery, not task success. | 78.6% | 80.8% |
|---|
| Estimated cost / completionInference tokens from all runs / completed runs, using list rates dated 2026-09-06. Excludes infrastructure and discounts. | $0.45 | $1.91 |
|---|
| Published ratingBradley–Terry over blind human judgments; ± is the 95% interval. A model under the provisional floor is listed and not rated, exactly as on the leaderboard. | 977 ± 28 | 1011 ± 32 |
|---|