Computer-use model comparison
In eligible head-to-head comparisons, Kimi K3 has a 38.9% decisive win rate and Qwen3.8-2.4T-A95B has 36.1%. 25.0% end without a decisive preference. These observed rates do not establish which model is best on every task.
These are arena-wide results. Each model encounters a different mix of tasks and opponents. The direct matchup, when available, is reported separately.
| Measure | Kimi K3ranked | Qwen3.8-2.4T-A95Branked |
|---|---|---|
| Leaderboard rankThe 95% rank band from the arena's Bradley–Terry fit. A range means the data cannot separate those positions; a model under the provisional floor takes no rank. | 2–12 | 2–12 |
| Win rate · all opponentsDecisive wins / eligible comparisons. Ties stay in the denominator. Opponent mixes differ. | 37.3% | 37.3% |
| CompletionAgent-reported completed runs / non-synthetic arena runs. Completion is not independently verified success. | 68.2% | 66.3% |
| SpeedMedian duration across runs, including unsuccessful runs. Shorter alone does not mean better. | 2.9 min | 4.2 min |
| RecoveryFailed actions whose next action did not fail. Recent benchmark window; a proxy for recovery, not task success. | 78.2% | 80.8% |
| Estimated cost / completionInference tokens from all runs / completed runs, using list rates dated 2026-09-06. Excludes infrastructure and discounts. | $1.94 | $1.91 |
| Published ratingBradley–Terry over blind human judgments; ± is the 95% interval. A model under the provisional floor is listed and not rated, exactly as on the leaderboard. | 1013 ± 30 | 1011 ± 32 |
In eligible head-to-head comparisons, Kimi K3 has a 38.9% decisive win rate and Qwen3.8-2.4T-A95B has 36.1%. 25.0% end without a decisive preference. These observed rates do not establish which model is best on every task.
No. Completion for Kimi K3 and Qwen3.8-2.4T-A95B records whether the agent reported finishing. Human preferences, task success and next-action recovery are different measurements.
Read speed and estimated cost alongside completion and human preference. An early failure can be fast. Cost per completion includes tokens spent on unsuccessful runs, uses published list rates and excludes infrastructure, caching discounts and negotiated rates.
Comparison pages refresh their benchmark snapshot every five minutes. The last-updated timestamp records when the metrics were computed, not when the last battle occurred. Model rank may move between snapshots.