wuyang/llm-atlas
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

research: audit reduced AttnRes study

Browse Source
This commit is contained in:
wuyang
2026-07-30 07:15:05 +08:00
parent 5f49906be6
commit d1d9d22bf3
6 changed files with 25838 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
experiments/k3/attnres/README.md
+21
View File
@@ -41,3 +41,24 @@ python experiments/k3/attnres/train.py \
Raw parquet and checkpoints stay in the local cache. Frozen manifests, metric
JSON, analyses, code, checksums, and a compact website payload enter the public
repository.
## Validate and aggregate the complete study
After the nine formal cells, the preregistered replay, and the paired smoke runs
exist in the cache:
```bash
python experiments/k3/attnres/analyze.py \
--formal-dir /home/wuyang/.cache/llm-atlas/k3-attnres-reduced-v1/formal \
--smoke-dir /home/wuyang/.cache/llm-atlas/k3-attnres-reduced-v1/smoke \
--replay /home/wuyang/.cache/llm-atlas/k3-attnres-reduced-v1/replay/block-2026073001.json \
--manifest experiments/k3/attnres/manifest.json \
--output src/data/k3-attnres-reduced.json \
--compact-output src/data/k3-attnres-reduced-compact.json \
--reproduction-output experiments/k3/attnres/reproduction.json
```
The aggregator fails closed on protocol identity, grid completeness, byte
budget, schedule hashes, shared initialization, non-finite metrics, diagnostic
shape, smoke mismatch, or formal replay mismatch. Timing is recorded but is not
required to replay bit-for-bit.