Add Agent evaluation report site

This commit is contained in:
wuyang
2026-07-27 16:44:10 +08:00
parent df475e8d90
commit cd1eacbd9e
15 changed files with 2487 additions and 0 deletions
+17
View File
@@ -65,6 +65,7 @@ The strongest current conclusion is that recent progress is concentrated in bett
| research | `research/memory/` | field findings and evidence ledger |
| Agent evaluation | `research/evaluation/` | executable design contract for task suites, validators, paired comparisons, and release gates |
| evaluation data/tools | `data/evaluation/`, `tools/evaluation/` | versioned task contracts and JSONL result scorer |
| evaluation report | `evaluation-site/` | Chinese interactive explanation of the contract, decision gates, tasks, and artifacts |
| research data | `data/research/` | committed corpus, screening, landscape and CSV ledger |
| research tools | `tools/research/` | paginated search, abstract fetch, screening, classification, landscape build |
| experiments | `experiments/knowledge-compilation/` | failed pilot and completed field audit |
@@ -112,6 +113,9 @@ zk-data-agent runtime/events + Zero decision-loop constraints
Only the task contracts and scorer exist in this repository. The reusable runner, fixtures, validators,
and real-model comparison still need to be implemented in `zk-data-agent`.
`evaluation-site/` visualizes this contract but does not add evidence. Its adjustable decision values are
explicitly labeled as a method simulation, not a real benchmark.
## Web Application
Capabilities currently implemented:
@@ -149,6 +153,19 @@ On 2026-07-27 both the Tailscale endpoint and `https://lab.k1412.top/api/health`
The live Ollama inventory checked on 2026-07-12 included `ChatGPT-5.6:Luna`, `Terra`, `Sol`, `auto`, `embed`, and `gpt-4o:latest`. The web defaults were updated from stale `light/fast/large` tags to configurable Luna/Terra/Sol tiers.
The static Agent evaluation report is packaged separately:
```text
source: evaluation-site/
public mapping: https://agent-eval.k1412.top/
container port: 8080
health: /health
deployment: Unraid Compose Manager, app slug agent-eval
```
It uses no Ollama or runtime API. The source report remains usable even when the research application is
offline.
## Runtime Constraints
- Python standard library only; no package installation is required for the current web server and collection scripts.