Record Agent evaluation site deployment

This commit is contained in:
wuyang
2026-07-27 16:49:44 +08:00
parent cd1eacbd9e
commit 5373d564ec
6 changed files with 33 additions and 3 deletions
+1
View File
@@ -27,6 +27,7 @@ Do not assume the public web service is running just because the repository is h
```bash ```bash
web/manage.sh status web/manage.sh status
curl -fsS https://lab.k1412.top/api/health | jq curl -fsS https://lab.k1412.top/api/health | jq
curl -fsS https://agent-eval.k1412.top/health
``` ```
## Actual Goal ## Actual Goal
+6
View File
@@ -166,6 +166,11 @@ deployment: Unraid Compose Manager, app slug agent-eval
It uses no Ollama or runtime API. The source report remains usable even when the research application is It uses no Ollama or runtime API. The source report remains usable even when the research application is
offline. offline.
The 2026-07-27 deployment uses immutable image
`docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb` on NAS host port 12005. Container health,
NAS/VPS Tailscale reachability, HTTP-to-HTTPS redirect, HTTP/2, Let's Encrypt SAN, static-asset hashes,
public desktop/mobile rendering, and the homepage entry were all verified.
## Runtime Constraints ## Runtime Constraints
- Python standard library only; no package installation is required for the current web server and collection scripts. - Python standard library only; no package installation is required for the current web server and collection scripts.
@@ -195,6 +200,7 @@ Live validation:
web/manage.sh status web/manage.sh status
curl -fsS http://100.114.68.27:18080/api/health | jq curl -fsS http://100.114.68.27:18080/api/health | jq
curl -fsS https://lab.k1412.top/api/health | jq curl -fsS https://lab.k1412.top/api/health | jq
curl -fsS https://agent-eval.k1412.top/health
``` ```
The health payload reports app/assets versions, paper count, available/default models, and missing default model tags. The health payload reports app/assets versions, paper count, available/default models, and missing default model tags.
+5
View File
@@ -255,3 +255,8 @@ The first Docker build attempt exposed two deployment details:
Decision retained: an explanation report is acceptable before the runner because it displays the Decision retained: an explanation report is acceptable before the runner because it displays the
contract and its missing evidence. It must not evolve into a score dashboard until real Result JSONL contract and its missing evidence. It must not evolve into a score dashboard until real Result JSONL
exists. exists.
The report was deployed as immutable image
`docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb` through Unraid Compose Manager on NAS port
12005. NPM route and Let's Encrypt HTTPS were enabled for `https://agent-eval.k1412.top/`, and the site
was registered in the k1412 homepage `projects` category.
+2
View File
@@ -17,6 +17,8 @@ python3 -m http.server 4173 --directory evaluation-site
- health path: `/health` - health path: `/health`
- public URL: `https://agent-eval.k1412.top/` - public URL: `https://agent-eval.k1412.top/`
- deployment: k1412 Unraid Compose Manager - deployment: k1412 Unraid Compose Manager
- NAS host port: `12005`
- immutable image: `docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb`
网页是阅读入口,事实源仍是: 网页是阅读入口,事实源仍是:
+1 -1
View File
@@ -10,7 +10,7 @@
| KC-002 | 分页语料、受控对比和证据账本能支持领域进展判断 | completed | 建立 516 篇候选、32 篇全文池和 23 篇证据账本,得到可审计结论 | [记录](knowledge-compilation/2026-07-10-agent-memory-field-audit.md) | | KC-002 | 分页语料、受控对比和证据账本能支持领域进展判断 | completed | 建立 516 篇候选、32 篇全文池和 23 篇证据账本,得到可审计结论 | [记录](knowledge-compilation/2026-07-10-agent-memory-field-audit.md) |
| OPS-001 | 完整仓库交接可以让无会话上下文的 AI 继续工作 | completed | 增加状态、历史、下一步、完整性检查、模型校验和 systemd 服务管理 | [记录](operations/2026-07-12-project-handoff-audit.md) | | OPS-001 | 完整仓库交接可以让无会话上下文的 AI 继续工作 | completed | 增加状态、历史、下一步、完整性检查、模型校验和 systemd 服务管理 | [记录](operations/2026-07-12-project-handoff-audit.md) |
| EVAL-001 | 现有运行事件和隔离工作区可扩展为可决策的 Agent 评测体系 | completed | 形成任务契约、分层评测、独立判分、gain/regression 对照和评分器;尚未运行真实模型 | [记录](agent-evaluation/2026-07-27-k1412-agent-evaluation-design.md) | | EVAL-001 | 现有运行事件和隔离工作区可扩展为可决策的 Agent 评测体系 | completed | 形成任务契约、分层评测、独立判分、gain/regression 对照和评分器;尚未运行真实模型 | [记录](agent-evaluation/2026-07-27-k1412-agent-evaluation-design.md) |
| OPS-002 | 评估结论可以用交互报告展示而不伪装成真实跑分 | validated-local | 完成中文静态报告、决策演算器、任务筛选、响应式验证和健康镜像;等待公开部署 | [记录](operations/2026-07-27-agent-eval-site.md) | | OPS-002 | 评估结论可以用交互报告展示而不伪装成真实跑分 | completed | 中文报告、决策演算器、任务筛选、响应式和镜像验证通过,已部署 HTTPS 并注册首页 | [记录](operations/2026-07-27-agent-eval-site.md) |
## Experiment Rules ## Experiment Rules
@@ -1,6 +1,6 @@
# 实验:Agent 评估结论网页 # 实验:Agent 评估结论网页
status: validated-local status: completed
## 问题 ## 问题
@@ -48,11 +48,27 @@ index/assets: HTTP 200
`0644`,Nginx 因目录不可遍历而返回 404。修复为先用 `0755` 创建目录,再以 `0644` `0644`,Nginx 因目录不可遍历而返回 404。修复为先用 `0755` 创建目录,再以 `0644`
复制文件。 复制文件。
## 公开验证
```text
immutable image: docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb
NAS mapping: 12005 -> 8080
container health: healthy
Compose Manager label: present
VPS -> NAS Tailscale health: HTTP 200
HTTP -> HTTPS: 301
HTTPS: HTTP/2 200
certificate SAN: agent-eval.k1412.top
public asset hashes: match source
public Chromium: status 200, tasks 10, overflow 0, console errors 0
homepage entry: AGENT EVAL / projects / order 130
```
## 当前边界 ## 当前边界
- 演算器使用示例数值,不是 Agent 实验结果。 - 演算器使用示例数值,不是 Agent 实验结果。
- 任务列表只展示契约状态,不表示八个缺 Runner 的任务已经可运行。 - 任务列表只展示契约状态,不表示八个缺 Runner 的任务已经可运行。
- 公开部署和首页注册完成后再把本记录升级为 `completed` - 网页仍不能代替真实模型实验和独立 Validator
## 部署目标 ## 部署目标