Record completion research site deployment
This commit is contained in:
+23
-12
@@ -1,7 +1,7 @@
|
||||
# Project Status
|
||||
|
||||
last_reviewed: 2026-07-27
|
||||
baseline_before_update: `5373d56`
|
||||
last_reviewed: 2026-07-28
|
||||
baseline_before_update: `4c88faa`
|
||||
branch: `main`
|
||||
remote: `https://git.k1412.top/wuyang/agent.git`
|
||||
|
||||
@@ -80,7 +80,7 @@ evaluation contract.
|
||||
| research | `research/memory/`, `research/completion-verification/` | field findings and evidence ledgers |
|
||||
| Agent evaluation | `research/evaluation/` | executable design contract for task suites, validators, paired comparisons, and release gates |
|
||||
| evaluation data/tools | `data/evaluation/`, `tools/evaluation/` | versioned task contracts and JSONL result scorer |
|
||||
| evaluation report | `evaluation-site/` | Chinese interactive explanation of the contract, decision gates, tasks, and artifacts |
|
||||
| research document | `evaluation-site/` | completion research reading view, generated evidence index, and archived v1 evaluation report |
|
||||
| research data | `data/research/` | committed corpus, screening, landscape and CSV ledger |
|
||||
| research tools | `tools/research/` | paginated search, abstract fetch, screening, classification, landscape build |
|
||||
| experiments | `experiments/knowledge-compilation/` | failed pilot and completed full-text research audits |
|
||||
@@ -145,8 +145,9 @@ intentionally paused while the research findings are reviewed. Before implementa
|
||||
need separate outcome/invariant/procedure/semantic-residual layers, non-binary
|
||||
`ambiguous/unverifiable` states, and explicit recovery-stage fields.
|
||||
|
||||
`evaluation-site/` visualizes this contract but does not add evidence. Its adjustable decision values are
|
||||
explicitly labeled as a method simulation, not a real benchmark.
|
||||
`evaluation-site/` now uses the completion/verification audit as its homepage. The old v1 contract
|
||||
visualization remains at `/evaluation-v1.html`; its adjustable decision values are still explicitly
|
||||
labeled as a method simulation, not a real benchmark.
|
||||
|
||||
## Web Application
|
||||
|
||||
@@ -185,7 +186,7 @@ On 2026-07-27 both the Tailscale endpoint and `https://lab.k1412.top/api/health`
|
||||
|
||||
The live Ollama inventory checked on 2026-07-12 included `ChatGPT-5.6:Luna`, `Terra`, `Sol`, `auto`, `embed`, and `gpt-4o:latest`. The web defaults were updated from stale `light/fast/large` tags to configurable Luna/Terra/Sol tiers.
|
||||
|
||||
The static Agent evaluation report is packaged separately:
|
||||
The static Agent completion research document is packaged separately:
|
||||
|
||||
```text
|
||||
source: evaluation-site/
|
||||
@@ -193,15 +194,24 @@ public mapping: https://agent-eval.k1412.top/
|
||||
container port: 8080
|
||||
health: /health
|
||||
deployment: Unraid Compose Manager, app slug agent-eval
|
||||
archived v1: /evaluation-v1.html
|
||||
```
|
||||
|
||||
It uses no Ollama or runtime API. The source report remains usable even when the research application is
|
||||
offline.
|
||||
It uses no Ollama or runtime API. The homepage presents the eight completion/verification/recovery
|
||||
conclusions, capability decomposition, evidence/recovery chains, 2023-2026 progression, the explicitly
|
||||
unvalidated system synthesis, unresolved questions, and a searchable/filterable 40-paper source pool
|
||||
containing 37 audited records.
|
||||
|
||||
The 2026-07-27 deployment uses immutable image
|
||||
`docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb` on NAS host port 12005. Container health,
|
||||
NAS/VPS Tailscale reachability, HTTP-to-HTTPS redirect, HTTP/2, Let's Encrypt SAN, static-asset hashes,
|
||||
public desktop/mobile rendering, and the homepage entry were all verified.
|
||||
The evidence browser is deterministically generated from
|
||||
`research/completion-verification/evidence-ledger.md` by
|
||||
`evaluation-site/build_research_data.py`. `tools/check_project.py` verifies the source hash and the
|
||||
40/37/26 pool, audited, and core counts.
|
||||
|
||||
The 2026-07-28 deployment uses immutable image
|
||||
`docker.k1412.top/wuyang/agent-eval:20260727T165727Z-4c88faa` on NAS host port 12005. Container health,
|
||||
Compose Manager ownership, NAS/VPS Tailscale reachability, HTTP-to-HTTPS redirect, HTTP/2, Let's Encrypt
|
||||
SAN, static-asset hashes, public desktop/mobile rendering, evidence filters, and the archived page were
|
||||
verified. The existing `AGENT EVAL` homepage entry remains under `projects` at order 130.
|
||||
|
||||
## Runtime Constraints
|
||||
|
||||
@@ -221,6 +231,7 @@ public desktop/mobile rendering, and the homepage entry were all verified.
|
||||
Offline validation:
|
||||
|
||||
```bash
|
||||
python3 evaluation-site/build_research_data.py --check
|
||||
python3 tools/check_project.py
|
||||
python3 -m unittest tools.evaluation.test_score_agent_runs
|
||||
git diff --check
|
||||
|
||||
Reference in New Issue
Block a user