 copilot-swe-agent[bot]
|
231b977b92
|
Add 10 standard evaluation benchmark suites with CLI runner and README
Implements HumanEval, MBPP, SWE-Bench, Aider, LiveCodeBench (coding),
MATH, GSM8K, AIME (math), and IFEval, BFCL (instruction following).
Each suite includes built-in problem subsets (108 total) and supports
loading full datasets from JSONL files. Includes comprehensive README
with all commands.
Agent-Logs-Url: https://github.com/HarnessLab/claw-code-agent/sessions/6890e3d0-3058-4b1f-b7e5-27171c079c62
Co-authored-by: abdoelsayed2016 <27821589+abdoelsayed2016@users.noreply.github.com>
|
2026-04-05 19:58:00 +00:00 |
|