Record Agent evaluation site deployment
This commit is contained in:
@@ -27,6 +27,7 @@ Do not assume the public web service is running just because the repository is h
|
|||||||
```bash
|
```bash
|
||||||
web/manage.sh status
|
web/manage.sh status
|
||||||
curl -fsS https://lab.k1412.top/api/health | jq
|
curl -fsS https://lab.k1412.top/api/health | jq
|
||||||
|
curl -fsS https://agent-eval.k1412.top/health
|
||||||
```
|
```
|
||||||
|
|
||||||
## Actual Goal
|
## Actual Goal
|
||||||
|
|||||||
@@ -166,6 +166,11 @@ deployment: Unraid Compose Manager, app slug agent-eval
|
|||||||
It uses no Ollama or runtime API. The source report remains usable even when the research application is
|
It uses no Ollama or runtime API. The source report remains usable even when the research application is
|
||||||
offline.
|
offline.
|
||||||
|
|
||||||
|
The 2026-07-27 deployment uses immutable image
|
||||||
|
`docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb` on NAS host port 12005. Container health,
|
||||||
|
NAS/VPS Tailscale reachability, HTTP-to-HTTPS redirect, HTTP/2, Let's Encrypt SAN, static-asset hashes,
|
||||||
|
public desktop/mobile rendering, and the homepage entry were all verified.
|
||||||
|
|
||||||
## Runtime Constraints
|
## Runtime Constraints
|
||||||
|
|
||||||
- Python standard library only; no package installation is required for the current web server and collection scripts.
|
- Python standard library only; no package installation is required for the current web server and collection scripts.
|
||||||
@@ -195,6 +200,7 @@ Live validation:
|
|||||||
web/manage.sh status
|
web/manage.sh status
|
||||||
curl -fsS http://100.114.68.27:18080/api/health | jq
|
curl -fsS http://100.114.68.27:18080/api/health | jq
|
||||||
curl -fsS https://lab.k1412.top/api/health | jq
|
curl -fsS https://lab.k1412.top/api/health | jq
|
||||||
|
curl -fsS https://agent-eval.k1412.top/health
|
||||||
```
|
```
|
||||||
|
|
||||||
The health payload reports app/assets versions, paper count, available/default models, and missing default model tags.
|
The health payload reports app/assets versions, paper count, available/default models, and missing default model tags.
|
||||||
|
|||||||
@@ -255,3 +255,8 @@ The first Docker build attempt exposed two deployment details:
|
|||||||
Decision retained: an explanation report is acceptable before the runner because it displays the
|
Decision retained: an explanation report is acceptable before the runner because it displays the
|
||||||
contract and its missing evidence. It must not evolve into a score dashboard until real Result JSONL
|
contract and its missing evidence. It must not evolve into a score dashboard until real Result JSONL
|
||||||
exists.
|
exists.
|
||||||
|
|
||||||
|
The report was deployed as immutable image
|
||||||
|
`docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb` through Unraid Compose Manager on NAS port
|
||||||
|
12005. NPM route and Let's Encrypt HTTPS were enabled for `https://agent-eval.k1412.top/`, and the site
|
||||||
|
was registered in the k1412 homepage `projects` category.
|
||||||
|
|||||||
@@ -17,6 +17,8 @@ python3 -m http.server 4173 --directory evaluation-site
|
|||||||
- health path: `/health`
|
- health path: `/health`
|
||||||
- public URL: `https://agent-eval.k1412.top/`
|
- public URL: `https://agent-eval.k1412.top/`
|
||||||
- deployment: k1412 Unraid Compose Manager
|
- deployment: k1412 Unraid Compose Manager
|
||||||
|
- NAS host port: `12005`
|
||||||
|
- immutable image: `docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb`
|
||||||
|
|
||||||
网页是阅读入口,事实源仍是:
|
网页是阅读入口,事实源仍是:
|
||||||
|
|
||||||
|
|||||||
@@ -10,7 +10,7 @@
|
|||||||
| KC-002 | 分页语料、受控对比和证据账本能支持领域进展判断 | completed | 建立 516 篇候选、32 篇全文池和 23 篇证据账本,得到可审计结论 | [记录](knowledge-compilation/2026-07-10-agent-memory-field-audit.md) |
|
| KC-002 | 分页语料、受控对比和证据账本能支持领域进展判断 | completed | 建立 516 篇候选、32 篇全文池和 23 篇证据账本,得到可审计结论 | [记录](knowledge-compilation/2026-07-10-agent-memory-field-audit.md) |
|
||||||
| OPS-001 | 完整仓库交接可以让无会话上下文的 AI 继续工作 | completed | 增加状态、历史、下一步、完整性检查、模型校验和 systemd 服务管理 | [记录](operations/2026-07-12-project-handoff-audit.md) |
|
| OPS-001 | 完整仓库交接可以让无会话上下文的 AI 继续工作 | completed | 增加状态、历史、下一步、完整性检查、模型校验和 systemd 服务管理 | [记录](operations/2026-07-12-project-handoff-audit.md) |
|
||||||
| EVAL-001 | 现有运行事件和隔离工作区可扩展为可决策的 Agent 评测体系 | completed | 形成任务契约、分层评测、独立判分、gain/regression 对照和评分器;尚未运行真实模型 | [记录](agent-evaluation/2026-07-27-k1412-agent-evaluation-design.md) |
|
| EVAL-001 | 现有运行事件和隔离工作区可扩展为可决策的 Agent 评测体系 | completed | 形成任务契约、分层评测、独立判分、gain/regression 对照和评分器;尚未运行真实模型 | [记录](agent-evaluation/2026-07-27-k1412-agent-evaluation-design.md) |
|
||||||
| OPS-002 | 评估结论可以用交互报告展示而不伪装成真实跑分 | validated-local | 完成中文静态报告、决策演算器、任务筛选、响应式验证和健康镜像;等待公开部署 | [记录](operations/2026-07-27-agent-eval-site.md) |
|
| OPS-002 | 评估结论可以用交互报告展示而不伪装成真实跑分 | completed | 中文报告、决策演算器、任务筛选、响应式和镜像验证通过,已部署 HTTPS 并注册首页 | [记录](operations/2026-07-27-agent-eval-site.md) |
|
||||||
|
|
||||||
## Experiment Rules
|
## Experiment Rules
|
||||||
|
|
||||||
|
|||||||
@@ -1,6 +1,6 @@
|
|||||||
# 实验:Agent 评估结论网页
|
# 实验:Agent 评估结论网页
|
||||||
|
|
||||||
status: validated-local
|
status: completed
|
||||||
|
|
||||||
## 问题
|
## 问题
|
||||||
|
|
||||||
@@ -48,11 +48,27 @@ index/assets: HTTP 200
|
|||||||
`0644`,Nginx 因目录不可遍历而返回 404。修复为先用 `0755` 创建目录,再以 `0644`
|
`0644`,Nginx 因目录不可遍历而返回 404。修复为先用 `0755` 创建目录,再以 `0644`
|
||||||
复制文件。
|
复制文件。
|
||||||
|
|
||||||
|
## 公开验证
|
||||||
|
|
||||||
|
```text
|
||||||
|
immutable image: docker.k1412.top/wuyang/agent-eval:20260727T084425Z-cd1eacb
|
||||||
|
NAS mapping: 12005 -> 8080
|
||||||
|
container health: healthy
|
||||||
|
Compose Manager label: present
|
||||||
|
VPS -> NAS Tailscale health: HTTP 200
|
||||||
|
HTTP -> HTTPS: 301
|
||||||
|
HTTPS: HTTP/2 200
|
||||||
|
certificate SAN: agent-eval.k1412.top
|
||||||
|
public asset hashes: match source
|
||||||
|
public Chromium: status 200, tasks 10, overflow 0, console errors 0
|
||||||
|
homepage entry: AGENT EVAL / projects / order 130
|
||||||
|
```
|
||||||
|
|
||||||
## 当前边界
|
## 当前边界
|
||||||
|
|
||||||
- 演算器使用示例数值,不是 Agent 实验结果。
|
- 演算器使用示例数值,不是 Agent 实验结果。
|
||||||
- 任务列表只展示契约状态,不表示八个缺 Runner 的任务已经可运行。
|
- 任务列表只展示契约状态,不表示八个缺 Runner 的任务已经可运行。
|
||||||
- 公开部署和首页注册完成后再把本记录升级为 `completed`。
|
- 网页仍不能代替真实模型实验和独立 Validator。
|
||||||
|
|
||||||
## 部署目标
|
## 部署目标
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user