Refresh papers and define Agent evaluation
This commit is contained in:
@@ -51,6 +51,8 @@ Treat repository artifacts according to their evidence level:
|
||||
6. Auto tags and model screening outputs: high-recall triage, never final truth.
|
||||
|
||||
The old `learning/agent-memory/` module is retained as a failed experiment. It is not the current synthesis.
|
||||
The Agent evaluation design under `research/evaluation/` is an implementation contract, not a completed
|
||||
benchmark. Its task contracts explicitly mark which runners do not exist yet.
|
||||
|
||||
## Repository Contracts
|
||||
|
||||
@@ -100,6 +102,12 @@ web/manage.sh logs
|
||||
python3 tools/research/search_arxiv_memory.py --help
|
||||
python3 tools/research/screen_memory_corpus.py --help
|
||||
python3 tools/research/build_memory_landscape.py --help
|
||||
|
||||
# Collection fallback when the arXiv export API is unavailable
|
||||
python3 tools/collection/collect_arxiv.py --backend search-html --help
|
||||
|
||||
# Aggregate Agent evaluation result JSONL
|
||||
python3 tools/evaluation/score_agent_runs.py --help
|
||||
```
|
||||
|
||||
Read the scripts before rerunning network or model-heavy research jobs. The committed research data is the reproducible snapshot; a refresh changes the time boundary and may be expensive.
|
||||
|
||||
Reference in New Issue
Block a user