Record Agent evaluation site deployment
This commit is contained in:
@@ -27,6 +27,7 @@ Do not assume the public web service is running just because the repository is h
|
||||
```bash
|
||||
web/manage.sh status
|
||||
curl -fsS https://lab.k1412.top/api/health | jq
|
||||
curl -fsS https://agent-eval.k1412.top/health
|
||||
```
|
||||
|
||||
## Actual Goal
|
||||
|
||||
@@ -166,6 +166,11 @@ deployment: Unraid Compose Manager, app slug agent-eval
|
||||
It uses no Ollama or runtime API. The source report remains usable even when the research application is
|
||||
offline.
|
||||
|
||||
The 2026-07-27 deployment uses immutable image
|
||||
`docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb` on NAS host port 12005. Container health,
|
||||
NAS/VPS Tailscale reachability, HTTP-to-HTTPS redirect, HTTP/2, Let's Encrypt SAN, static-asset hashes,
|
||||
public desktop/mobile rendering, and the homepage entry were all verified.
|
||||
|
||||
## Runtime Constraints
|
||||
|
||||
- Python standard library only; no package installation is required for the current web server and collection scripts.
|
||||
@@ -195,6 +200,7 @@ Live validation:
|
||||
web/manage.sh status
|
||||
curl -fsS http://100.114.68.27:18080/api/health | jq
|
||||
curl -fsS https://lab.k1412.top/api/health | jq
|
||||
curl -fsS https://agent-eval.k1412.top/health
|
||||
```
|
||||
|
||||
The health payload reports app/assets versions, paper count, available/default models, and missing default model tags.
|
||||
|
||||
@@ -255,3 +255,8 @@ The first Docker build attempt exposed two deployment details:
|
||||
Decision retained: an explanation report is acceptable before the runner because it displays the
|
||||
contract and its missing evidence. It must not evolve into a score dashboard until real Result JSONL
|
||||
exists.
|
||||
|
||||
The report was deployed as immutable image
|
||||
`docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb` through Unraid Compose Manager on NAS port
|
||||
12005. NPM route and Let's Encrypt HTTPS were enabled for `https://agent-eval.k1412.top/`, and the site
|
||||
was registered in the k1412 homepage `projects` category.
|
||||
|
||||
@@ -17,6 +17,8 @@ python3 -m http.server 4173 --directory evaluation-site
|
||||
- health path: `/health`
|
||||
- public URL: `https://agent-eval.k1412.top/`
|
||||
- deployment: k1412 Unraid Compose Manager
|
||||
- NAS host port: `12005`
|
||||
- immutable image: `docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb`
|
||||
|
||||
网页是阅读入口,事实源仍是:
|
||||
|
||||
|
||||
@@ -10,7 +10,7 @@
|
||||
| KC-002 | 分页语料、受控对比和证据账本能支持领域进展判断 | completed | 建立 516 篇候选、32 篇全文池和 23 篇证据账本,得到可审计结论 | [记录](knowledge-compilation/2026-07-10-agent-memory-field-audit.md) |
|
||||
| OPS-001 | 完整仓库交接可以让无会话上下文的 AI 继续工作 | completed | 增加状态、历史、下一步、完整性检查、模型校验和 systemd 服务管理 | [记录](operations/2026-07-12-project-handoff-audit.md) |
|
||||
| EVAL-001 | 现有运行事件和隔离工作区可扩展为可决策的 Agent 评测体系 | completed | 形成任务契约、分层评测、独立判分、gain/regression 对照和评分器;尚未运行真实模型 | [记录](agent-evaluation/2026-07-27-k1412-agent-evaluation-design.md) |
|
||||
| OPS-002 | 评估结论可以用交互报告展示而不伪装成真实跑分 | validated-local | 完成中文静态报告、决策演算器、任务筛选、响应式验证和健康镜像;等待公开部署 | [记录](operations/2026-07-27-agent-eval-site.md) |
|
||||
| OPS-002 | 评估结论可以用交互报告展示而不伪装成真实跑分 | completed | 中文报告、决策演算器、任务筛选、响应式和镜像验证通过,已部署 HTTPS 并注册首页 | [记录](operations/2026-07-27-agent-eval-site.md) |
|
||||
|
||||
## Experiment Rules
|
||||
|
||||
|
||||
@@ -1,6 +1,6 @@
|
||||
# 实验:Agent 评估结论网页
|
||||
|
||||
status: validated-local
|
||||
status: completed
|
||||
|
||||
## 问题
|
||||
|
||||
@@ -48,11 +48,27 @@ index/assets: HTTP 200
|
||||
`0644`,Nginx 因目录不可遍历而返回 404。修复为先用 `0755` 创建目录,再以 `0644`
|
||||
复制文件。
|
||||
|
||||
## 公开验证
|
||||
|
||||
```text
|
||||
immutable image: docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb
|
||||
NAS mapping: 12005 -> 8080
|
||||
container health: healthy
|
||||
Compose Manager label: present
|
||||
VPS -> NAS Tailscale health: HTTP 200
|
||||
HTTP -> HTTPS: 301
|
||||
HTTPS: HTTP/2 200
|
||||
certificate SAN: agent-eval.k1412.top
|
||||
public asset hashes: match source
|
||||
public Chromium: status 200, tasks 10, overflow 0, console errors 0
|
||||
homepage entry: AGENT EVAL / projects / order 130
|
||||
```
|
||||
|
||||
## 当前边界
|
||||
|
||||
- 演算器使用示例数值,不是 Agent 实验结果。
|
||||
- 任务列表只展示契约状态,不表示八个缺 Runner 的任务已经可运行。
|
||||
- 公开部署和首页注册完成后再把本记录升级为 `completed`。
|
||||
- 网页仍不能代替真实模型实验和独立 Validator。
|
||||
|
||||
## 部署目标
|
||||
|
||||
|
||||
Reference in New Issue
Block a user