# Paper: Do Coding Agents Deceive Us? Detecting and Preventing Cheating via Capped Evaluation with Randomized Tests

---
type: paper
title: Do Coding Agents Deceive Us? Detecting and Preventing Cheating via Capped Evaluation with Randomized Tests
authors: Thanawat Lodkaew, Johannes Ackermann, Soichiro Nishimori, Nontawat Charoenphakdee, Masashi Sugiyama, Takashi Ishida
year: 2026
venue: arXiv
url: https://arxiv.org/abs/2606.07379
code_url:
source: arxiv
collected_at: 2026-07-08
published_at: 2026-06-05
updated_at: 2026-06-08
status: queued
relevance: high
topics:
  - agent-evaluation
  - coding-agent
  - rag
methods:
  -
benchmarks:
  -
models:
  -
datasets:
  - cs.LG
  - cs.AI
  - cs.CL
  - stat.ME
related_concepts:
  -
related_jobs:
  -
related_experiments:
  -
related_projects:
  -
collection_score: 14
collection_queries: agent-evaluation
---

## One-line Takeaway

Auto-collected from arXiv because it matched the Agent collection queries. Needs human skim.

## Why Collected

- matched queries: agent-evaluation
- inferred topics: agent-evaluation, coding-agent, rag
- arXiv categories: cs.LG, cs.AI, cs.CL, stat.ME
- collection score: 14

## Review Checklist

- Does this paper directly inform Agent architecture, evaluation, memory, tools, safety, coding agents, GUI/browser agents, or multi-agent workflows?
- Does it include a benchmark, dataset, code, or reproducible experimental setup?
- Should it be promoted from `queued` to `skimmed` or `summarized`?

## Links

- arXiv: https://arxiv.org/abs/2606.07379