Refresh papers and define Agent evaluation

This commit is contained in:
wuyang
2026-07-27 16:28:23 +08:00
parent 8e4ff3779b
commit df475e8d90
180 changed files with 31313 additions and 160 deletions
+8
View File
@@ -51,6 +51,8 @@ Treat repository artifacts according to their evidence level:
6. Auto tags and model screening outputs: high-recall triage, never final truth.
The old `learning/agent-memory/` module is retained as a failed experiment. It is not the current synthesis.
The Agent evaluation design under `research/evaluation/` is an implementation contract, not a completed
benchmark. Its task contracts explicitly mark which runners do not exist yet.
## Repository Contracts
@@ -100,6 +102,12 @@ web/manage.sh logs
python3 tools/research/search_arxiv_memory.py --help
python3 tools/research/screen_memory_corpus.py --help
python3 tools/research/build_memory_landscape.py --help
# Collection fallback when the arXiv export API is unavailable
python3 tools/collection/collect_arxiv.py --backend search-html --help
# Aggregate Agent evaluation result JSONL
python3 tools/evaluation/score_agent_runs.py --help
```
Read the scripts before rerunning network or model-heavy research jobs. The committed research data is the reproducible snapshot; a refresh changes the time boundary and may be expensive.