Add Agent evaluation report site

This commit is contained in:
wuyang
2026-07-27 16:44:10 +08:00
parent df475e8d90
commit cd1eacbd9e
15 changed files with 2487 additions and 0 deletions
+5
View File
@@ -53,6 +53,8 @@ Treat repository artifacts according to their evidence level:
The old `learning/agent-memory/` module is retained as a failed experiment. It is not the current synthesis.
The Agent evaluation design under `research/evaluation/` is an implementation contract, not a completed
benchmark. Its task contracts explicitly mark which runners do not exist yet.
`evaluation-site/` is a presentation layer for that contract. It must not introduce stronger claims than
the research artifact or display simulation values as real benchmark results.
## Repository Contracts
@@ -108,6 +110,9 @@ python3 tools/collection/collect_arxiv.py --backend search-html --help
# Aggregate Agent evaluation result JSONL
python3 tools/evaluation/score_agent_runs.py --help
# Preview the static Agent evaluation report
python3 -m http.server 4173 --directory evaluation-site
```
Read the scripts before rerunning network or model-heavy research jobs. The committed research data is the reproducible snapshot; a refresh changes the time boundary and may be expensive.