修改
This commit is contained in:
@@ -444,15 +444,25 @@ assets/
|
||||
|
||||
#### 写法
|
||||
|
||||
**强烈推荐结构化三段写法**(`summary` / `proposal` / `ask`)——UI 会渲染成"现状 / 提议 / 请选"三个带标签行,用户一眼看明白。`reason` 留作 fallback。
|
||||
|
||||
```bash
|
||||
# R0 baseline 之后想让用户拍板是否进 train
|
||||
echo '{"step":"human-check","status":"running","run_id":"R0","reason":"R0 baseline 分析完成,目标子集 X.X% 偏低,确认是否按当前 H1 候选进 R1 train","ts":"'$(date -Iseconds)'"}' >> $S
|
||||
# R0 baseline 之后想让用户拍板是否进 train(推荐结构化)
|
||||
echo '{"step":"human-check","status":"running","run_id":"R0",
|
||||
"summary":"R0 baseline 完成;复杂导航过召专项0511 = 58.89%(53/90),37 错全为 complex 误判",
|
||||
"proposal":"H1(标签纠错):把 7 条原标 complex=true 但实际是简单导航的样本改回 complex=false。 H2(数据增强):仿写 100 条 complex=false 的简单导航 query 补进训练集,平衡正负样本",
|
||||
"ask":"是否按 H1+H2 一起进 R1 train?还是先只跑 H1 验证一轮?",
|
||||
"ts":"'$(date -Iseconds)'"}' >> $S
|
||||
|
||||
# R1 评测发现 regression,需要用户决定是否回滚
|
||||
echo '{"step":"human-review","status":"running","run_id":"R1","reason":"R1 vs R0:导航bvt -3.2pp, 可聊可控 -25pp,建议回滚","ts":"'$(date -Iseconds)'"}' >> $S
|
||||
# R1 评测发现 regression
|
||||
echo '{"step":"human-review","status":"running","run_id":"R1",
|
||||
"summary":"R1 vs R0:导航bvt -3.2pp,可聊可控 -25pp,目标子集 +1.4pp",
|
||||
"proposal":"回滚到 R0 权重;下一轮把 H2 仿写量减半,避免对 complex=false 过拟合",
|
||||
"ask":"回滚 R0 还是继续跑 R2 看曲线?",
|
||||
"ts":"'$(date -Iseconds)'"}' >> $S
|
||||
|
||||
# 候选量超 200 条命中触发条件 #3
|
||||
echo '{"step":"human-check","status":"running","run_id":"R0","reason":"候选量 412 条命中触发条件 #3","ts":"'$(date -Iseconds)'"}' >> $S
|
||||
# fallback:只写 reason 也能跑(前端会启发式切分),但不如结构化清晰
|
||||
echo '{"step":"human-check","status":"running","run_id":"R0","reason":"候选量 412 命中规则上限,需要人工定更精细 pattern 收窄","ts":"'$(date -Iseconds)'"}' >> $S
|
||||
```
|
||||
|
||||
**顺序不能反**:先 echo gate entry → 再 chat reply 给用户。否则用户先看到聊天问话、UI 里却没卡,会困惑"流程是不是卡死了"。
|
||||
@@ -464,9 +474,30 @@ echo '{"step":"human-check","status":"running","run_id":"R0","reason":"候选量
|
||||
| `step` | ✅ | `human-check` 或 `human-review` |
|
||||
| `status` | ✅ | 卡进入时写 `running`;用户回复后写 `complete` |
|
||||
| `run_id` | ✅ | 当前所在轮次(决定 gate 插在哪个 section 后) |
|
||||
| `reason` | ⭕ | 触发原因——直接展示给用户看,写具体一些("Gold drift 12 条,触发 #1" 比 "需要人审" 强得多) |
|
||||
| `summary` | 🔼 | **现状一句话**:跑了什么、关键数字。例:`R0 baseline 完成;专项 58.89%(53/90),37 错全为 complex 误判` |
|
||||
| `proposal` | 🔼 | **打算怎么干**:每个 H 单独说"H? (类型):具体做什么"。详见下面规则 |
|
||||
| `ask` | 🔼 | **让用户选什么**:用问句给出 A/B 选项。例:`是否按 H1+H2 进 R1 train?还是先只跑 H1 验证一轮?` |
|
||||
| `reason` | ⭕ | 兜底用:没写 summary/proposal/ask 时前端会拿 reason 做启发式切分。但**优先用结构化三段**,别只写 reason |
|
||||
| `ts` | ✅ | ISO 时间戳 |
|
||||
|
||||
🔼 = 强烈推荐写——三段都填 UI 会变成清晰的"现状/提议/请选"分块;都不填只填 reason 也能跑,但用户要自己抠语义。
|
||||
|
||||
#### proposal 写法规则(关键)
|
||||
|
||||
**每个假设单独一句,结构 = `H? (一两个字概括类型):具体动作 + 数量 + 目标`**。比如:
|
||||
|
||||
- ✅ `H1(标签纠错):把 7 条原标 complex=true 但实际是简单导航的样本改回 complex=false`
|
||||
- ✅ `H2(数据增强):仿写 100 条 complex=false 的简单导航 query 补进训练集`
|
||||
- ❌ `H1 修 7 条 mislabeled` ← 用户要猜 mislabeled 是什么意思
|
||||
- ❌ `H2 仿写 100 条 complex=false 简单导航` ← 没说补到哪、为啥补
|
||||
|
||||
**不要写进 proposal 的内容**:
|
||||
- §X.X.X 规则引用(`触发 §4.0.1 Step B`、`命中条件 #3`)—— 用户不关心你按哪条规则做的,只关心你要做什么
|
||||
- 流程自洽说明(`需要人工逐条审 1/0`、`走 sanity check`、`过 label-master 复核`)—— 这些是 agent 内部流程,对用户决策没用
|
||||
- 候选量区间括号注释(`100~150 触发 51-200 区间`)—— 数量 OK,区间归属归属是规则细节,删
|
||||
|
||||
写 proposal 时问自己:**"这句话如果交给一个新加入的产品同学看,他能不能 5 秒内明白要干什么"**。能 = ✅;得回头查 §X.X.X 才能懂 = ❌,重写。
|
||||
|
||||
**用户拍板回复后**:append `status:"complete"` 同 step + run_id 一行,gate 卡变 COMPLETED;然后才继续往下走(继续/回滚/调参)。
|
||||
|
||||
**两种 gate 的区分(约定)**:
|
||||
|
||||
Reference in New Issue
Block a user