agent/papers/items/2026-2606-29537-osworld2-0-benchmarking-computer-use-agents-on-long-horizon-real-world-tasks.md

Paper: OSWorld2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks

---

type: paper title: "OSWorld2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks" authors: Mengqi Yuan, Zilong Zhou, Xinzhuang Xiong, Weiming Wu, Jiayang Sun, Jiamin Song, Kaiqian Cui, Bowen Wang, et al. year: 2026 venue: arXiv url: https://arxiv.org/abs/2606.29537 code_url: source: arxiv collected_at: 2026-07-08 published_at: 2026-06-28 updated_at: 2026-06-28 status: queued relevance: high topics:

• agent-evaluation
• agent-safety
• coding-agent
• computer-use
• memory
• planning
• rag
• reasoning
• tool-use
• workflow-agent methods:

benchmarks:

models:

datasets:

• cs.AI related_concepts:

related_jobs:

related_experiments:

related_projects:

collection_score: 21 collection_queries: web-gui-agent

One-line Takeaway

Auto-collected from arXiv because it matched the Agent collection queries. Needs human skim.

Why Collected

• matched queries: web-gui-agent
• inferred topics: agent-evaluation, agent-safety, coding-agent, computer-use, memory, planning, rag, reasoning, tool-use, workflow-agent
• arXiv categories: cs.AI
• collection score: 21

Review Checklist

• Does this paper directly inform Agent architecture, evaluation, memory, tools, safety, coding agents, GUI/browser agents, or multi-agent workflows?
• Does it include a benchmark, dataset, code, or reproducible experimental setup?
• Should it be promoted from queued to skimmed or summarized?

Links

• arXiv: https://arxiv.org/abs/2606.29537