Add Agent evaluation report site
This commit is contained in:
@@ -53,6 +53,8 @@ Treat repository artifacts according to their evidence level:
|
||||
The old `learning/agent-memory/` module is retained as a failed experiment. It is not the current synthesis.
|
||||
The Agent evaluation design under `research/evaluation/` is an implementation contract, not a completed
|
||||
benchmark. Its task contracts explicitly mark which runners do not exist yet.
|
||||
`evaluation-site/` is a presentation layer for that contract. It must not introduce stronger claims than
|
||||
the research artifact or display simulation values as real benchmark results.
|
||||
|
||||
## Repository Contracts
|
||||
|
||||
@@ -108,6 +110,9 @@ python3 tools/collection/collect_arxiv.py --backend search-html --help
|
||||
|
||||
# Aggregate Agent evaluation result JSONL
|
||||
python3 tools/evaluation/score_agent_runs.py --help
|
||||
|
||||
# Preview the static Agent evaluation report
|
||||
python3 -m http.server 4173 --directory evaluation-site
|
||||
```
|
||||
|
||||
Read the scripts before rerunning network or model-heavy research jobs. The committed research data is the reproducible snapshot; a refresh changes the time boundary and may be expensive.
|
||||
|
||||
Reference in New Issue
Block a user