OSWorld 2.1

Agentic computer use

OSWorld is a multimodal benchmark that tests an agent’s ability to complete real tasks in a desktop operating system — navigating GUIs, clicking, typing and using applications the way a person would. Release 2.1 is 108 long-horizon tasks on a live Ubuntu virtual machine, graded against weighted checkpoints. The partial score is the mean per-task credit across checkpoints; the strict pass rate counts only tasks where every checkpoint is satisfied.