feat: add paired DeepSeek routing length control

2026-07-29 16:17:18 +08:00
parent 059458f8e3
commit 9ca08501a8
15 changed files with 318874 additions and 69 deletions
@@ -100,3 +100,56 @@ The committed independent rerun is byte-exact. Both JSON files have SHA-256:

 See `research/DEEPSEEK_ROUTING_CORPUS_AUDIT.md` for corpus revisions and hashes,
 metric definitions, interval semantics, results, and claim boundaries.
+
+## Paired length-control cohort
+
+The corpus runner can also select one fixed cohort by untruncated source length
+and execute nested prefixes. The committed 16-token and 24-token traces use the
+same 128 source prompts, all selected from records with at least 24 DeepSeek
+tokens:
+
+```bash
+common_args=(
+  --per-domain 32
+  --batch-size 16
+  --bootstrap 2000
+  --sample-salt llm-atlas-deepseek-routing-length-control-v1
+  --eligibility-min-tokens 24
+)
+
+python -B experiments/deepseek/v2_lite_routing_corpus.py \
+  ...source arguments... \
+  "${common_args[@]}" \
+  --max-tokens 16 \
+  --output src/data/deepseek-v2-lite-routing-matched16.json
+
+python -B experiments/deepseek/v2_lite_routing_corpus.py \
+  ...source arguments... \
+  "${common_args[@]}" \
+  --max-tokens 24 \
+  --output src/data/deepseek-v2-lite-routing-matched24.json
+```
+
+The two real traces add 184,320 top-6 route selections. Their independent
+reruns are byte-exact:
+
+```text
+matched-16  f8d437d5379ffb41ac8dca5a8e97c0f44ba10ce7b63f95d7be0b7c88ac0baebd
+matched-24  bed54835ad243ca2ab46bf9574e53137e6c2c0e19267f581719b5f2f65546436
+```
+
+Use the paired comparison runner to resample identical prompt indices in the
+short and long traces:
+
+```bash
+python -B experiments/deepseek/compare_routing_length_control.py \
+  --short src/data/deepseek-v2-lite-routing-matched16.json \
+  --long src/data/deepseek-v2-lite-routing-matched24.json \
+  --output src/data/deepseek-v2-lite-routing-length-sensitivity.json \
+  --bootstrap 2000 \
+  --seed 20260729
+```
+
+See `research/DEEPSEEK_ROUTING_LENGTH_CONTROL_AUDIT.md` for the sampling bias
+audit, paired CV/JSD deltas, total-variation accounting, and interpretation
+boundaries.