Files
agent/papers/items/2026-2606-28430-building-to-the-test-coding-agents-deliver-what-you-check-not-what-you-requested.md
2026-07-08 12:25:30 +08:00

1.3 KiB

Paper: Building to the Test: Coding Agents Deliver What You Check, Not What You Requested


type: paper title: "Building to the Test: Coding Agents Deliver What You Check, Not What You Requested" authors: Yanuo Ma, Ben Kereopa-Yorke, Ben Schultz year: 2026 venue: arXiv url: https://arxiv.org/abs/2606.28430 code_url: source: arxiv collected_at: 2026-07-08 published_at: 2026-06-26 updated_at: 2026-06-26 status: queued relevance: high topics:

  • agent-evaluation
  • coding-agent methods:

benchmarks:

models:

datasets:

  • cs.SE
  • cs.AI related_concepts:

collection_score: 13 collection_queries: coding-agent

One-line Takeaway

Auto-collected from arXiv because it matched the Agent collection queries. Needs human skim.

Why Collected

  • matched queries: coding-agent
  • inferred topics: agent-evaluation, coding-agent
  • arXiv categories: cs.SE, cs.AI
  • collection score: 13

Review Checklist

  • Does this paper directly inform Agent architecture, evaluation, memory, tools, safety, coding agents, GUI/browser agents, or multi-agent workflows?
  • Does it include a benchmark, dataset, code, or reproducible experimental setup?
  • Should it be promoted from queued to skimmed or summarized?