Add Agent evaluation report site
This commit is contained in:
@@ -65,6 +65,7 @@ The strongest current conclusion is that recent progress is concentrated in bett
|
||||
| research | `research/memory/` | field findings and evidence ledger |
|
||||
| Agent evaluation | `research/evaluation/` | executable design contract for task suites, validators, paired comparisons, and release gates |
|
||||
| evaluation data/tools | `data/evaluation/`, `tools/evaluation/` | versioned task contracts and JSONL result scorer |
|
||||
| evaluation report | `evaluation-site/` | Chinese interactive explanation of the contract, decision gates, tasks, and artifacts |
|
||||
| research data | `data/research/` | committed corpus, screening, landscape and CSV ledger |
|
||||
| research tools | `tools/research/` | paginated search, abstract fetch, screening, classification, landscape build |
|
||||
| experiments | `experiments/knowledge-compilation/` | failed pilot and completed field audit |
|
||||
@@ -112,6 +113,9 @@ zk-data-agent runtime/events + Zero decision-loop constraints
|
||||
Only the task contracts and scorer exist in this repository. The reusable runner, fixtures, validators,
|
||||
and real-model comparison still need to be implemented in `zk-data-agent`.
|
||||
|
||||
`evaluation-site/` visualizes this contract but does not add evidence. Its adjustable decision values are
|
||||
explicitly labeled as a method simulation, not a real benchmark.
|
||||
|
||||
## Web Application
|
||||
|
||||
Capabilities currently implemented:
|
||||
@@ -149,6 +153,19 @@ On 2026-07-27 both the Tailscale endpoint and `https://lab.k1412.top/api/health`
|
||||
|
||||
The live Ollama inventory checked on 2026-07-12 included `ChatGPT-5.6:Luna`, `Terra`, `Sol`, `auto`, `embed`, and `gpt-4o:latest`. The web defaults were updated from stale `light/fast/large` tags to configurable Luna/Terra/Sol tiers.
|
||||
|
||||
The static Agent evaluation report is packaged separately:
|
||||
|
||||
```text
|
||||
source: evaluation-site/
|
||||
public mapping: https://agent-eval.k1412.top/
|
||||
container port: 8080
|
||||
health: /health
|
||||
deployment: Unraid Compose Manager, app slug agent-eval
|
||||
```
|
||||
|
||||
It uses no Ollama or runtime API. The source report remains usable even when the research application is
|
||||
offline.
|
||||
|
||||
## Runtime Constraints
|
||||
|
||||
- Python standard library only; no package installation is required for the current web server and collection scripts.
|
||||
|
||||
Reference in New Issue
Block a user