agent/papers/items/2026-2606-07379-do-coding-agents-deceive-us-detecting-and-preventing-cheating-via-capped-evaluat.md

Paper: Do Coding Agents Deceive Us? Detecting and Preventing Cheating via Capped Evaluation with Randomized Tests

---

type: paper title: Do Coding Agents Deceive Us? Detecting and Preventing Cheating via Capped Evaluation with Randomized Tests authors: Thanawat Lodkaew, Johannes Ackermann, Soichiro Nishimori, Nontawat Charoenphakdee, Masashi Sugiyama, Takashi Ishida year: 2026 venue: arXiv url: https://arxiv.org/abs/2606.07379 code_url: source: arxiv collected_at: 2026-07-08 published_at: 2026-06-05 updated_at: 2026-06-08 status: queued relevance: high topics:

• agent-evaluation
• coding-agent
• rag methods:

benchmarks:

models:

datasets:

• cs.LG
• cs.AI
• cs.CL
• stat.ME related_concepts:

related_jobs:

related_experiments:

related_projects:

collection_score: 14 collection_queries: agent-evaluation

One-line Takeaway

Auto-collected from arXiv because it matched the Agent collection queries. Needs human skim.

Why Collected

• matched queries: agent-evaluation
• inferred topics: agent-evaluation, coding-agent, rag
• arXiv categories: cs.LG, cs.AI, cs.CL, stat.ME
• collection score: 14

Review Checklist

• Does this paper directly inform Agent architecture, evaluation, memory, tools, safety, coding agents, GUI/browser agents, or multi-agent workflows?
• Does it include a benchmark, dataset, code, or reproducible experimental setup?
• Should it be promoted from queued to skimmed or summarized?

Links

• arXiv: https://arxiv.org/abs/2606.07379