Dataset
Computer-use trajectories, human judgments, and provenance.
Account consent is required. Dataset packages include each step’s screenshot; agents receive raw frames during runs.
Collection, privacy, and frame handling
The licence covering submitted tasks, judgments and attached files is granted at sign-in. Every record is consented at collection and text- and URL-redacted before delivery, and a contributor can withdraw at any time from their account page. Every package includes each step’s screenshot: the masked copy where the detector masked a browser page, the original otherwise. Frames from battles that used a saved sign-in never ship, and the keyed API serves no frame bytes. The mask has never been audited for residual personal data, desktop frames carry none, and during a run the model provider driving each agent receives every frame unmasked. Phone battles are not in any dataset. Arena governance and affiliation disclosure
Task categories
Loading the category distribution.
Dataset access
Public sample
Public
Open teaser: enough to evaluate the schema, deliberately not enough to train on.
What’s included
- Voted battles as NDJSON, one record each
- First three actions per run, truncation flagged
- No key, no contract, no conversation
Preference data
Licensed
Pairwise human judgments over two trajectories that started from the same state.
What’s included
- Blind votes on answer and on route
- Reasoning traces uncapped, on every step that emitted one
- Flaw annotations with judge counts and per-label blindness provenance
Trajectory licensing
Licensed
SFT-ready computer-use demonstrations, with the failures included rather than filtered out.
What’s included
- Action, reasoning, and observation per step
- The screenshot of every step in packaged deliveries, masked where the detector found sensitive regions on a web page
- Run errors, not just successful outcomes
Eval access
Full
Everything above, plus the battle internals an eval harness needs to score a model.
What’s included
- Everything in trajectory licensing
- Passive judge-behavior capture
- Internal battle metadata, unreduced
Request access