# Paper: CRAB-Bench: Evaluating LLM Agents under Complex Task Dependencies and Human-aligned User Simulation

---
type: paper
title: "CRAB-Bench: Evaluating LLM Agents under Complex Task Dependencies and Human-aligned User Simulation"
authors: Danqing Wang, Akshay Sivaraman, Lei Li
year: 2026
venue: arXiv
url: https://arxiv.org/abs/2606.01815
code_url:
source: arxiv
collected_at: 2026-07-08
published_at: 2026-06-01
updated_at: 2026-06-01
status: queued
relevance: high
topics:
  - agent-evaluation
  - tool-use
  - world-model
methods:
  -
benchmarks:
  -
models:
  -
datasets:
  - cs.CL
related_concepts:
  -
related_jobs:
  -
related_experiments:
  -
related_projects:
  -
collection_score: 15
collection_queries: agent-evaluation
---

## One-line Takeaway

Auto-collected from arXiv because it matched the Agent collection queries. Needs human skim.

## Why Collected

- matched queries: agent-evaluation
- inferred topics: agent-evaluation, tool-use, world-model
- arXiv categories: cs.CL
- collection score: 15

## Review Checklist

- Does this paper directly inform Agent architecture, evaluation, memory, tools, safety, coding agents, GUI/browser agents, or multi-agent workflows?
- Does it include a benchmark, dataset, code, or reproducible experimental setup?
- Should it be promoted from `queued` to `skimmed` or `summarized`?

## Links

- arXiv: https://arxiv.org/abs/2606.01815